Jun 26 02:37:39.618779 np0000003683 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
Jun 26 02:37:41.167866 np0000003683 nova-compute[98991]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98991) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
Jun 26 02:37:41.168596 np0000003683 nova-compute[98991]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98991) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
Jun 26 02:37:41.168596 np0000003683 nova-compute[98991]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
Jun 26 02:37:41.290858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:37:41.300805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:37:41.343548 np0000003683 nova-compute[98991]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
Jun 26 02:37:42.076662 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
Jun 26 02:37:42.076823 np0000003683 nova-compute[98991]: INFO nova.utils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] The long task thread pool MainProcess.long_task is initialized
Jun 26 02:37:42.077110 np0000003683 nova-compute[98991]: INFO nova.virt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jun 26 02:37:42.276046 np0000003683 nova-compute[98991]: INFO nova.compute.provider_config [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jun 26 02:37:42.778201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Acquiring lock "singleton_lock" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:37:42.778386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Acquired lock "singleton_lock" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:37:42.778588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Releasing lock "singleton_lock" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:37:42.778742 np0000003683 nova-compute[98991]: WARNING oslo_service.backend._threading.service [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] no_fork=True: running service in main process
Jun 26 02:37:42.779009 np0000003683 nova-compute[98991]: INFO nova.service [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Starting compute node (version 33.1.0)
Jun 26 02:37:43.281840 np0000003683 nova-compute[98991]: INFO nova.utils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] The default thread pool MainProcess.default is initialized
Jun 26 02:37:43.282470 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:37:43.282772 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Starting event thread {{(pid=98991) start /opt/stack/nova/nova/virt/libvirt/host.py:251}}
Jun 26 02:37:43.283101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Starting connection event dispatch thread {{(pid=98991) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}}
Jun 26 02:37:43.283804 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Connecting to libvirt: qemu:///system {{(pid=98991) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}}
Jun 26 02:37:44.104228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0> {{(pid=98991) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}}
Jun 26 02:37:44.106945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0> {{(pid=98991) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}}
Jun 26 02:37:44.109505 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Connection event '1' reason 'None'
Jun 26 02:37:44.610967 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Cannot update service status on host "np0000003683" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003683 could not be found.
Jun 26 02:37:44.611532 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.mount [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Initialising _HostMountState generation 0 {{(pid=98991) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host capabilities <capabilities>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:   <host>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     <uuid>0f9b6f66-39b4-4e40-a8fd-87dc4e236f72</uuid>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     <cpu>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <arch>x86_64</arch>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <model>EPYC-Milan</model>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <microcode version='16777317'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <signature family='25' model='1' stepping='1'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <topology sockets='16' dies='1' cores='1' threads='1'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <maxphysaddr mode='emulate' bits='40'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='x2apic'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='tsc-deadline'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='osxsave'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='hypervisor'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='tsc_adjust'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='ospke'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='vaes'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='vpclmulqdq'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='spec-ctrl'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='stibp'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='arch-capabilities'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='ssbd'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='cmp_legacy'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='topoext'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='stibp-always-on'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='virt-ssbd'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='amd-psfd'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='lbrv'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='tsc-scale'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='vmcb-clean'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='flushbyasid'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='pause-filter'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='pfthreshold'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='v-vmsave-vmload'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='vgif'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='no-nested-data-bp'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='lfence-always-serializing'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='null-sel-clr-base'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='rdctl-no'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='skip-l1dfl-vmentry'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='mds-no'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='pschange-mc-no'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <feature name='gds-no'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <pages unit='KiB' size='4'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <pages unit='KiB' size='2048'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <pages unit='KiB' size='1048576'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     </cpu>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     <power_management/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     <iommu support='no'/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     <migration_features>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <live/>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       <uri_transports>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:         <uri_transport>tcp</uri_transport>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:         <uri_transport>rdma</uri_transport>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:       </uri_transports>
Jun 26 02:37:54.741736 np0000003683 nova-compute[98991]:     </migration_features>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:     <topology>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       <cells num='1'>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:         <cell id='0'>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <memory unit='KiB'>65844276</memory>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <pages unit='KiB' size='4'>16461069</pages>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <pages unit='KiB' size='2048'>0</pages>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <pages unit='KiB' size='1048576'>0</pages>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <distances>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <sibling id='0' value='10'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           </distances>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           <cpus num='16'>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='12' socket_id='12' die_id='12' core_id='0' siblings='12'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='13' socket_id='13' die_id='13' core_id='0' siblings='13'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='14' socket_id='14' die_id='14' core_id='0' siblings='14'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:             <cpu id='15' socket_id='15' die_id='15' core_id='0' siblings='15'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:           </cpus>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:         </cell>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       </cells>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:     </topology>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:     <cache>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
Jun 26 02:37:54.743472 np0000003683 nova-compute[98991]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='12' level='3' type='both' size='32' unit='MiB' cpus='12'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='13' level='3' type='both' size='32' unit='MiB' cpus='13'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='14' level='3' type='both' size='32' unit='MiB' cpus='14'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <bank id='15' level='3' type='both' size='32' unit='MiB' cpus='15'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     </cache>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <secmodel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <model>apparmor</model>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <doi>0</doi>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     </secmodel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <secmodel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <model>dac</model>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <doi>0</doi>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <baselabel type='kvm'>+64055:+993</baselabel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <baselabel type='qemu'>+64055:+993</baselabel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     </secmodel>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:   </host>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <arch name='alpha'>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>clipper</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:     <arch name='armv6l'>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 26 02:37:54.744282 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>borzoi</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>spitz</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>nuri</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-b1</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatileab</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>kzm</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-a</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>smdkc210</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>z2</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tosa</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>sabrelite</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-eb</machine>
Jun 26 02:37:54.747328 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n810</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n800</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatilepb</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>terrier</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mainstone</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>integratorcp</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>midway</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>musicpal</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>microbit</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='3'>fby35</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cubieboard</machine>
Jun 26 02:37:54.748195 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>verdex</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>bpim2u</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduino2</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>raspi2b</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cheetah</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>highbank</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>akita</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>connex</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>collie</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi0</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:     <arch name='armv7l'>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>borzoi</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>spitz</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>nuri</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 26 02:37:54.749836 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-b1</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatileab</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>kzm</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-a</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>smdkc210</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>z2</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tosa</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>sabrelite</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-eb</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 26 02:37:54.751755 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n810</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n800</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatilepb</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>terrier</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mainstone</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>integratorcp</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>midway</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>musicpal</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>microbit</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='3'>fby35</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cubieboard</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>verdex</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>bpim2u</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduino2</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 26 02:37:54.753165 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>raspi2b</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cheetah</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>highbank</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>akita</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>connex</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>collie</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi0</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:     <arch name='aarch64'>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>borzoi</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>spitz</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>nuri</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 26 02:37:54.754547 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-b1</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatileab</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>kzm</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>musca-a</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>smdkc210</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>z2</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>tosa</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>sabrelite</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-eb</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>sbsa-ref</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n810</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>n800</machine>
Jun 26 02:37:54.755377 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>versatilepb</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>terrier</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mainstone</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>integratorcp</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>midway</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>musicpal</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>microbit</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='3'>fby35</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>raspi3ap</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cubieboard</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>verdex</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>bpim2u</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduino2</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>raspi3b</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>raspi2b</machine>
Jun 26 02:37:54.756078 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>cheetah</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>highbank</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>akita</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>connex</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>collie</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>raspi0</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <acpi default='on' toggle='yes'/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <arch name='cris'>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>axis-dev88</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:     <arch name='i686'>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-mantic</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jun 26 02:37:54.757298 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-lunar</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.1</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jun 26 02:37:54.759384 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>x-remote</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>isapc</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.0</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
Jun 26 02:37:54.761035 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-noble</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-8.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.2</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>microvm</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jun 26 02:37:54.763713 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <domain type='kvm'/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <pae/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <nonpae/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <acpi default='on' toggle='yes'/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <apic default='on' toggle='no'/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:     <arch name='m68k'>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mcf5208evb</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-7.0</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>an5206</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-6.0</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>q800</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-8.1</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-7.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-6.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-8.0</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>next-cube</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-7.1</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-6.1</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virt-8.2</machine>
Jun 26 02:37:54.764963 np0000003683 nova-compute[98991]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <arch name='microblaze'>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <arch name='microblazeel'>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <arch name='mips'>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>malta</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mipssim</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <arch name='mipsel'>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>malta</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mipssim</machine>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.769131 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <arch name='mips64'>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>malta</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mipssim</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>pica61</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>magnum</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <arch name='mips64el'>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>malta</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>loongson3-virt</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mipssim</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>pica61</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>magnum</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='16'>boston</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>fuloong2e</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <arch name='ppc'>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g3beige</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>amigaone</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mac99</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ppce500</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sam460ex</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>pegasos2</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>bamboo</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>40p</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ref405ep</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.774242 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:     <arch name='ppc64'>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-noble</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>amigaone</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv9</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.1</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.1</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.5</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv10</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-xenial</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.2</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.2</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-yakkety</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.6</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ppce500</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.7</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-3.0</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.0</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.0</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>40p</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-lunar</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.8</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>pegasos2</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-hirsute</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-3.1</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.1</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.1</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-eoan</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.9</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-zesty</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>bamboo</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-groovy</machine>
Jun 26 02:37:54.777329 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-focal</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g3beige</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.2</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.2</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-disco</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-mantic</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-kinetic</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.10</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.0</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.11</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.1</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.1</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-cosmic</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-bionic</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.12</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.2</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.2</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mac99</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-impish</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-jammy</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-artful</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sam460ex</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ref405ep</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.3</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv8</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.0</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.0</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.4</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:     <arch name='ppc64le'>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-noble</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
Jun 26 02:37:54.780812 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>amigaone</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv9</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.1</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.1</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.5</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv10</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-xenial</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.2</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.2</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-yakkety</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.6</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ppce500</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.7</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-3.0</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.0</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.0</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>40p</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-lunar</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.8</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>pegasos2</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-hirsute</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-3.1</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.1</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.1</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-eoan</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.9</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-zesty</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>bamboo</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-groovy</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-focal</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>g3beige</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-8.2</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-5.2</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-disco</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-mantic</machine>
Jun 26 02:37:54.783568 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-kinetic</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.10</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.0</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.11</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.1</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.1</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-cosmic</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-bionic</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.12</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.2</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-7.2</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>mac99</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-impish</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-jammy</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-artful</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sam460ex</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>ref405ep</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.3</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='2048'>powernv8</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-4.0</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-6.0</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='4096'>pseries-2.4</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <arch name='riscv32'>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='8'>spike</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>opentitan</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='5'>sifive_u</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sifive_e</machine>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:     <arch name='riscv64'>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.784622 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='512'>virt</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='8'>spike</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='5'>sifive_u</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>shakti_c</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sifive_e</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:     <arch name='s390x'>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jun 26 02:37:54.787226 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <arch name='sh4'>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>shix</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>r2d</machine>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:     <arch name='sh4eb'>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.788093 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>shix</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>r2d</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <arch name='sparc'>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>SS-5</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>SS-20</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>LX</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>SPARCClassic</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>leon3_generic</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>SPARCbook</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>SS-4</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>SS-600MP</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>SS-10</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>Voyager</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <arch name='sparc64'>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sun4u</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>niagara</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>sun4v</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:     <arch name='x86_64'>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <wordsize>64</wordsize>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-mantic</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jun 26 02:37:54.790347 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-lunar</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.1</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
Jun 26 02:37:54.792719 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>x-remote</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='1'>isapc</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
Jun 26 02:37:54.793371 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-noble</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-8.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-7.2</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>microvm</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jun 26 02:37:54.793985 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <domain type='kvm'/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <acpi default='on' toggle='yes'/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <apic default='on' toggle='no'/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:     <arch name='xtensa'>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>sim</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>kc705</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ml605</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ml605-nommu</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>virt</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx60-nommu</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx200</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx200-nommu</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx60</machine>
Jun 26 02:37:54.794606 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>kc705-nommu</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <guest>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <os_type>hvm</os_type>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <arch name='xtensaeb'>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <wordsize>32</wordsize>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='4'>sim</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>kc705</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ml605</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>ml605-nommu</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>virt</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx60-nommu</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx200</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx200-nommu</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>lx60</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <machine maxCpus='32'>kc705-nommu</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <domain type='qemu'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     </arch>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <features>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <cpuselection/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <deviceboot/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <disksnapshot default='on' toggle='no'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <externalSnapshot/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     </features>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   </guest>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]: </capabilities>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]: 
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-alpha</path>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <machine>clipper</machine>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <arch>alpha</arch>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <vcpu max='4'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.795656 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.797143 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-arm</path>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <machine>virt-8.2</machine>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <arch>armv6l</arch>
Jun 26 02:37:54.798685 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 26 02:37:54.799759 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.800725 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.801666 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <gic supported='yes'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='version'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>2</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>3</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     </gic>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-arm</path>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <machine>virt-8.2</machine>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <arch>armv6l</arch>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 26 02:37:54.802998 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 26 02:37:54.804591 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.805139 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <gic supported='yes'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       <enum name='version'>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>2</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:         <value>3</value>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     </gic>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.806511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-arm</path>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <machine>virt-8.2</machine>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <arch>armv7l</arch>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 26 02:37:54.808303 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.809425 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.810574 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <gic supported='yes'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='version'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>2</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>3</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     </gic>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-aarch64</path>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <machine>virt-8.2</machine>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <arch>aarch64</arch>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.811859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>a64fx</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 26 02:37:54.812923 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.813717 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.814599 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <gic supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='version'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>2</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>3</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     </gic>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-cris</path>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <machine>axis-dev88</machine>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <arch>cris</arch>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.815883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.817608 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-i386</path>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <machine>pc-i440fx-noble</machine>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <arch>i686</arch>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <vcpu max='255'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.818920 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='lm'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.819993 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.820840 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.821707 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.822740 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-i386</path>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <machine>pc-q35-noble-v2</machine>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <arch>i686</arch>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <vcpu max='1024'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.824033 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='lm'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.825280 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.826117 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.826785 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.827611 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-i386</path>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <machine>pc-i440fx-noble-v2</machine>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <arch>i686</arch>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <vcpu max='255'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.828832 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='lm'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.830674 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.831832 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.832506 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.833650 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-i386</path>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <machine>pc-q35-noble</machine>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <arch>i686</arch>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <vcpu max='1024'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.835031 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='lm'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.836156 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.836980 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.837542 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.838241 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-m68k</path>
Jun 26 02:37:54.840396 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <machine>mcf5208evb</machine>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <arch>m68k</arch>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.841392 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-m68k</path>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <machine>virt-8.2</machine>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <arch>m68k</arch>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.842754 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.843983 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-microblaze</path>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <machine>petalogix-s3adsp1800</machine>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <arch>microblaze</arch>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.845294 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.846208 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-microblazeel</path>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <machine>petalogix-s3adsp1800</machine>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <arch>microblazeel</arch>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.848604 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.849568 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-mips</path>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <machine>malta</machine>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <arch>mips</arch>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <vcpu max='16'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.850860 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.851958 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-mipsel</path>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <machine>malta</machine>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <arch>mipsel</arch>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <vcpu max='16'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.853356 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.854592 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.855765 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-mips64</path>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <machine>malta</machine>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <arch>mips64</arch>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <vcpu max='16'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.856908 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.858426 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-mips64el</path>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <machine>malta</machine>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <arch>mips64el</arch>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <vcpu max='16'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.860543 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.862365 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc</path>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <machine>g3beige</machine>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <arch>ppc</arch>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.863665 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.864680 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <machine>pseries-noble</machine>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <arch>ppc64</arch>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <vcpu max='4096'/>
Jun 26 02:37:54.865889 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.867242 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>tpm-spapr</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>spapr-tpm-proxy</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.868652 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <machine>powernv9</machine>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <arch>ppc64</arch>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <vcpu max='2048'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.869946 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>tpm-spapr</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>spapr-tpm-proxy</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.871157 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <machine>pseries-noble</machine>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <arch>ppc64</arch>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <vcpu max='4096'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.872356 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.873583 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>tpm-spapr</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>spapr-tpm-proxy</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.874916 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc64le</path>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <machine>powernv9</machine>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <arch>ppc64le</arch>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <vcpu max='2048'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.876176 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>tpm-spapr</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>spapr-tpm-proxy</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.877332 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-ppc64le</path>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <machine>pseries-noble</machine>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <arch>ppc64le</arch>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <vcpu max='4096'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.878828 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.880061 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>tpm-spapr</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>spapr-tpm-proxy</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-riscv32</path>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   <machine>virt</machine>
Jun 26 02:37:54.881859 np0000003683 nova-compute[98991]:   <arch>riscv32</arch>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.882883 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.884158 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-riscv64</path>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <machine>virt</machine>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <arch>riscv64</arch>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <vcpu max='512'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>rv64</model>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>any</model>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
Jun 26 02:37:54.885405 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.886315 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.887576 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-s390x</path>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <machine>s390-ccw-virtio-noble</machine>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <arch>s390x</arch>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <vcpu max='248'/>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.3</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13-base</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.2</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z196.2-base</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14.2-base</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.4</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z196</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
Jun 26 02:37:54.888714 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z114-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen16b</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890.3-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen16a</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.5</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z196.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zEC12</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zEC12.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9BC</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z800-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.4-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC.3</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10BC.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen15a-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zBC12-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen16a-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900.3</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z196-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z800</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z14ZR1</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC.2</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC.3</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.5-base</model>
Jun 26 02:37:54.889600 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>max</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen15b</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen15a</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen16b-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z114</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13s</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>gen15b-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zEC12-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890.3</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890.2</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10BC-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z890-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9BC-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z10BC</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13.2-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990.3-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z13s-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>zBC12</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z990-base</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <model usable='no' vendor='IBM'>z9BC.2</model>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.890335 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.891249 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <s390-pv supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-sh4</path>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <machine>shix</machine>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <arch>sh4</arch>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.892598 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.893666 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-sh4eb</path>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <machine>shix</machine>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <arch>sh4eb</arch>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.894935 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.896088 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-sparc</path>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.897428 np0000003683 nova-compute[98991]:   <machine>SS-5</machine>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <arch>sparc</arch>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.898456 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <redirdev supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='model'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-sparc64</path>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <machine>sun4u</machine>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <arch>sparc64</arch>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <vcpu max='1'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.899843 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.901018 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.902298 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <machine>pc-i440fx-noble</machine>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <arch>x86_64</arch>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <vcpu max='255'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.903420 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.904385 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.905084 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.905715 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.906915 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <machine>pc-q35-noble-v2</machine>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <arch>x86_64</arch>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <vcpu max='1024'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.908278 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.909372 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.910397 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.910983 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.912104 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <machine>pc-i440fx-noble-v2</machine>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <arch>x86_64</arch>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <vcpu max='255'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.913403 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.914519 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.915207 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>ide</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.915828 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.916912 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <machine>pc-q35-noble</machine>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <arch>x86_64</arch>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <vcpu max='1024'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <enum name='firmware'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <value>efi</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='yes'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:       <enum name='maximumMigratable'>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>on</value>
Jun 26 02:37:54.918264 np0000003683 nova-compute[98991]:         <value>off</value>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='yes'>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model fallback='forbid'>EPYC</model>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <vendor>AMD</vendor>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='acpi'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='ss'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='monitor'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='hypervisor'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='erms'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='mpx'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='pcommit'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='clwb'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='umip'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='pku'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='vaes'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='la57'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='rdpid'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='pks'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrm'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='fzrm'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrs'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='fsrc'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnowext'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='3dnow'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='xsaveerptr'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='wbnoinvd'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='npt'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='vgif'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='require' name='svme-addr-chk'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='vme'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='xsavec'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='fxsr_opt'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='misalignsse'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='osvw'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='topoext'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <feature policy='disable' name='nrip-save'/>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:     <mode name='custom' supported='yes'>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 26 02:37:54.919363 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 26 02:37:54.920124 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <model usable='yes' vendor='unknown'>486</model>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     </mode>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.920705 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>vmvga</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>qxl</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>ramfb</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <tpm supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>tpm-tis</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>tpm-crb</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>passthrough</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>emulator</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>external</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='backendVersion'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>1.2</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>2.0</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </tpm>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.921751 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <genid supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <hyperv supported='yes'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <enum name='features'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>relaxed</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>vapic</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>spinlocks</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>vpindex</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>runtime</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>synic</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>stimer</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>reset</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>vendor_id</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>frequencies</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>reenlightenment</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>tlbflush</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>ipi</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>avic</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     </hyperv>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-xtensa</path>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <machine>sim</machine>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <arch>xtensa</arch>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <vcpu max='4'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.923365 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.924447 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98991) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]: <domainCapabilities>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:   <path>/usr/bin/qemu-system-xtensaeb</path>
Jun 26 02:37:54.925909 np0000003683 nova-compute[98991]:   <domain>qemu</domain>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <machine>sim</machine>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <arch>xtensaeb</arch>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <vcpu max='4'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <iothreads supported='yes'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <os supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <enum name='firmware'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <loader supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>rom</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>pflash</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='readonly'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>yes</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='secure'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>no</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     </loader>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <cpu>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <mode name='host-passthrough' supported='no'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <mode name='maximum' supported='no'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <mode name='host-model' supported='no'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <mode name='custom' supported='no'/>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <memoryBacking supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <enum name='sourceType'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <value>file</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <value>anonymous</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <value>memfd</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   </memoryBacking>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <disk supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='diskDevice'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>disk</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>cdrom</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>floppy</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>lun</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>fdc</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>sata</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <graphics supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>sdl</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>vnc</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>spice</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>egl-headless</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>dbus</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <video supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='modelType'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>vga</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>cirrus</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>none</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>bochs</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:     <hostdev supported='yes'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       <enum name='mode'>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:         <value>subsystem</value>
Jun 26 02:37:54.926947 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='startupPolicy'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>default</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>mandatory</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>requisite</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>optional</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='subsysType'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>pci</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>scsi</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='capsType'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='pciBackend'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </hostdev>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <rng supported='yes'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>virtio-transitional</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>virtio-non-transitional</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>random</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>egd</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <filesystem supported='yes'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='driverType'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>path</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>handle</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>virtiofs</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </filesystem>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <tpm supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <redirdev supported='yes'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='bus'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>usb</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </redirdev>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <channel supported='yes'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>pty</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>unix</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>spicevmc</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </channel>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <crypto supported='yes'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='model'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>virtio</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='type'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>qemu</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       <enum name='backendModel'>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:         <value>builtin</value>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:       </enum>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     </crypto>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <gic supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <vmcoreinfo supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <genid supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <backingStoreInput supported='yes'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <backup supported='yes'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <async-teardown supported='yes'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <sev supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:     <sgx supported='no'/>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]: </domainCapabilities>
Jun 26 02:37:54.928228 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 26 02:37:54.929386 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98991) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}}
Jun 26 02:37:54.929386 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98991) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}}
Jun 26 02:37:54.929386 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98991) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}}
Jun 26 02:37:54.929386 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Secure Boot support detected
Jun 26 02:37:55.371079 np0000003683 nova-compute[98991]: INFO nova.virt.node [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Generated node identity af1bc8b6-4321-4361-b703-e0f6b10a10af
Jun 26 02:37:55.371350 np0000003683 nova-compute[98991]: INFO nova.virt.node [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Wrote node identity af1bc8b6-4321-4361-b703-e0f6b10a10af to /opt/stack/data/nova/compute_id
Jun 26 02:37:55.873487 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Compute nodes ['af1bc8b6-4321-4361-b703-e0f6b10a10af'] for host np0000003683 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jun 26 02:37:56.877133 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jun 26 02:37:57.881474 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] No compute node record found for host np0000003683. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003683 could not be found.
Jun 26 02:37:57.881946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:37:57.881946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:37:57.881946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:37:57.882048 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:37:57.953580 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:37:57.954292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:37:57.966663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:37:57.966985 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=55583MB free_disk=75.2153549194336GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:37:57.967108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:37:57.967339 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:37:58.470050 np0000003683 nova-compute[98991]: WARNING nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] No compute node record for np0000003683:af1bc8b6-4321-4361-b703-e0f6b10a10af: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host af1bc8b6-4321-4361-b703-e0f6b10a10af could not be found.
Jun 26 02:37:58.974280 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Compute node record created for np0000003683:np0000003683 with uuid: af1bc8b6-4321-4361-b703-e0f6b10a10af
Jun 26 02:38:00.481028 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:38:00.481437 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:37:57 up 24 min,  2 users,  load average: 2.10, 1.43, 0.75\n'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:38:00.916029 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] [req-3357005f-40e0-4687-badd-218a82b806e3] Created resource provider record via placement API for resource provider with UUID af1bc8b6-4321-4361-b703-e0f6b10a10af and name np0000003683.
Jun 26 02:38:00.964063 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] /sys/module/kvm_amd/parameters/sev contains [N
Jun 26 02:38:00.964063 np0000003683 nova-compute[98991]: ] {{(pid=98991) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}}
Jun 26 02:38:00.964194 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.host [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] kernel doesn't support AMD SEV
Jun 26 02:38:00.964331 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:38:00.964529 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:38:00.964772 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Libvirt baseline CPU <cpu>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:   <arch>x86_64</arch>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:   <model>Nehalem</model>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:   <vendor>AMD</vendor>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:   <topology sockets="16" cores="1" threads="1"/>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:   <maxphysaddr mode="emulate" bits="40"/>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]: </cpu>
Jun 26 02:38:00.968449 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13761}}
Jun 26 02:38:01.531276 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Updated inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
Jun 26 02:38:01.531633 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Updating resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af generation from 0 to 1 during operation: update_inventory {{(pid=98991) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jun 26 02:38:01.531633 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:38:01.658723 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Updating resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af generation from 1 to 2 during operation: update_traits {{(pid=98991) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jun 26 02:38:02.165370 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:38:02.165580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.198s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:38:02.165763 np0000003683 nova-compute[98991]: DEBUG nova.service [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98991) start /opt/stack/nova/nova/service.py:196}}
Jun 26 02:38:02.179746 np0000003683 nova-compute[98991]: DEBUG nova.service [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98991) start /opt/stack/nova/nova/service.py:212}}
Jun 26 02:38:02.192382 np0000003683 nova-compute[98991]: DEBUG nova.service [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] Join ServiceGroup membership for this service compute {{(pid=98991) start /opt/stack/nova/nova/service.py:222}}
Jun 26 02:38:02.192552 np0000003683 nova-compute[98991]: DEBUG nova.servicegroup.drivers.db [None req-db7bc320-2bc6-4e8b-8d0d-ef3c965142e3 None None] DB_Driver: join new ServiceGroup member np0000003683 to the compute group, service = <Service: host=np0000003683, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98991) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jun 26 02:38:07.695738 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:38:17.194422 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:17.697947 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:17.699293 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.65 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:38:41.345102 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.345606 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.345655 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.345860 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.346061 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.346272 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.346461 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.346613 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:38:41.346777 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:38:41.849749 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:38:41.849910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:38:41.850076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:38:41.850251 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:38:41.858148 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:38:41.858856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:38:41.871966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:38:41.872857 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=55326MB free_disk=75.06415557861328GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:38:41.873024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:38:41.873161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:38:42.923379 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:38:42.923717 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:38:41 up 25 min,  2 users,  load average: 1.58, 1.38, 0.77\n'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:38:42.965178 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:38:42.965400 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:38:43.467910 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:38:43.973553 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:38:43.973960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:38:43.973960 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:39:43.968446 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.968876 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.968876 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.969230 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.969383 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.969505 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.969692 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.969887 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:43.970045 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:39:43.970230 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:39:44.473669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:39:44.473846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:39:44.473959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:39:44.474067 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:39:44.482399 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:39:44.483213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:39:44.496404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:39:44.496747 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=55309MB free_disk=74.84737014770508GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:39:44.496877 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:39:44.497129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:39:45.543734 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:39:45.544066 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:39:44 up 26 min,  2 users,  load average: 1.03, 1.26, 0.77\n'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:39:45.588220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:39:45.588448 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:39:46.090845 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:39:46.596764 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:39:46.597202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.100s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:39:46.597202 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:40:06.832518 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:06.832518 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:07.335125 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:07.699454 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:40:07.904573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:07.904963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:07.907256 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:07.907505 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Claim successful on node np0000003683
Jun 26 02:40:08.222390 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:08.222614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:08.384353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:08.384571 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:08.724738 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:08.886867 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:09.141394 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:09.142246 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:09.297570 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:09.455927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:09.645452 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:10.152058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.247s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:10.152725 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:10.155352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.858s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:10.161225 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:10.161442 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Claim successful on node np0000003683
Jun 26 02:40:10.659156 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:10.660021 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:10.661217 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:10.663143 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:11.162192 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:11.372945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:11.372945 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:11.652930 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa6ac420579348c284a33443abac5250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7249714268a84dc2942c668f4096bb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:11.670381 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:11.874835 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:12.384050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.228s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:12.384050 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:12.386838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.931s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:12.390937 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:12.390937 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Claim successful on node np0000003683
Jun 26 02:40:12.667175 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Successfully created port: 55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:12.678177 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:12.679493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:12.679753 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Creating image(s)
Jun 26 02:40:12.680732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:12.680732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:12.681045 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:12.681495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:12.681829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:12.889752 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:12.890052 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:12.890623 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:12.890859 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:13.016698 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd70e26fc3b243ffb390cf119334c5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc72b1dff20e43d1b244280499fc5f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:13.092316 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:13.096391 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:13.097050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:13.170886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.part --force-share --output=json" returned: 0 in 0.074s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:13.171793 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] eb0918cd-17b7-4dc6-8a46-002286996c07 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:40:13.172467 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:40:13.172467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.part /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:13.338962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.part /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.converted" returned: 0 in 0.166s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:13.345116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:13.395397 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:13.418268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7.converted --force-share --output=json" returned: 0 in 0.073s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:13.418967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.737s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:13.419412 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:13.428128 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:13.433355 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy20q59_t/privsep.sock']
Jun 26 02:40:13.443628 np0000003683 sudo[110379]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy20q59_t/privsep.sock
Jun 26 02:40:13.444434 np0000003683 sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 26 02:40:13.708273 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 26 02:40:13.708273 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:13.708273 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:13.708701 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 26 02:40:13.712090 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:13.712387 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:13.909493 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:14.073653 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 26 02:40:14.073748 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:14.073823 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:14.073929 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:14.074039 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:14.074079 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:14.074107 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:14.074172 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:14.075521 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 26 02:40:14.116443 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Successfully created port: 809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:14.216111 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:14.303826 np0000003683 sudo[110379]: pam_unix(sudo:session): session closed for user root
Jun 26 02:40:14.305497 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Spawned new privsep daemon via rootwrap
Jun 26 02:40:14.307226 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 26 02:40:14.307344 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 26 02:40:14.307521 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 26 02:40:14.307521 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110500
Jun 26 02:40:14.311559 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Successfully updated port: 55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:14.412727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:14.498530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:14.499016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:14.499605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:14.500157 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:14.504366 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:14.504890 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:14.575452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:14.579757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:14.610145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk 1073741824" returned: 0 in 0.033s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:14.611412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.111s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:14.611754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:14.677297 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:14.678020 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:14.678584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:14.725288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.339s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:14.726377 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:14.750222 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:14.750652 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Cannot resize image /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:14.751207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:14.751411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Ensure instance console log exists: /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:14.751774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:14.751936 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:14.752310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:14.814201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:14.814616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquired lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:14.814616 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:14.924934 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Successfully updated port: 809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:14.933714 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:14.934752 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:14.935314 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Creating image(s)
Jun 26 02:40:14.935787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:14.935966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:14.936403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:14.937080 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:14.940260 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:14.941953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:15.007929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:15.008356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:15.008887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:15.011377 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:15.014343 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:15.014696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:15.101795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:15.103185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:15.126728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk 1073741824" returned: 0 in 0.023s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:15.127221 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.118s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:15.127699 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:15.188207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.060s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:15.188902 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:15.189188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:15.210110 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received event network-changed-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:15.210809 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Refreshing instance network info cache due to event network-changed-55c855da-4062-4f73-8b16-5c7716de5da5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:15.211015 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] Acquiring lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:15.239797 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:15.240091 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:15.240601 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:15.241043 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:15.264845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:15.265715 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Cannot resize image /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:15.265853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:15.265981 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Ensure instance console log exists: /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:15.266845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:15.266845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:15.266845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:15.427566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:15.428064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:15.428064 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:15.438490 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc748533ff1b49ecbfc2f8e239350cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3004e12281740988b4f5119899f222b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:15.460925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-changed-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:15.461064 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Refreshing instance network info cache due to event network-changed-809bd0a4-ea36-4c23-a2fd-5cfa28760410. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:15.461216 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:15.580618 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:15.744770 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:16.092363 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Successfully created port: 5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:16.250387 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:16.386734 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:17.115884 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:17.264485 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:17.265210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:17.265873 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Creating image(s)
Jun 26 02:40:17.266118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:17.266324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:17.267167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:17.269135 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:17.275314 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:17.279196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:17.314304 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Successfully updated port: 5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:17.340388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:17.341166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:17.341655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:17.342165 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:17.345623 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:17.346268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:17.416845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:17.417344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:17.450600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk 1073741824" returned: 0 in 0.033s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:17.452071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.110s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:17.452495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:17.493070 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Updating instance_info_cache with network_info: [{"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:17.519879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:17.520302 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:17.520675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:17.539441 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-changed-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:17.539677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing instance network info cache due to event network-changed-5279d472-fd5f-40b3-9130-196439442d5b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:17.539973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] Acquiring lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:17.540099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] Acquired lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:17.540302 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing network info cache for port 5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:17.559799 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:17.584520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:17.584849 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Cannot resize image /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:17.585327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:17.585494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Ensure instance console log exists: /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:17.585745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:17.587208 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:17.587208 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:17.729296 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:17.820291 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:17.999076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Releasing lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:17.999490 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Instance network_info: |[{"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:17.999844 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] Acquired lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:18.000011 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Refreshing network info cache for port 55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:18.004804 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Start _get_guest_xml network_info=[{"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:18.009191 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:18.011732 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-678791422', uuid='78756f9d-416d-4bb5-a50b-f7401d3789c2'), owner=OwnerMeta(userid='aa6ac420579348c284a33443abac5250', username='tempest-DeleteServersTestJSON-70351402-project-member', projectid='7249714268a84dc2942c668f4096bb5b', projectname='tempest-DeleteServersTestJSON-70351402'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441618.0106182) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:18.014063 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:18.015613 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:18.016437 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:18.016888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:18.019797 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:18.020688 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:18.021049 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:18.021049 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:18.021147 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:18.021722 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:18.021722 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:18.021722 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:18.022435 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:18.022435 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:18.022435 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:18.022625 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:18.035026 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:40:18.035919 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-678791422',display_name='tempest-DeleteServersTestJSON-server-678791422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-deleteserverstestjson-server-678791422',id=1,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7249714268a84dc2942c668f4096bb5b',ramdisk_id='',reservation_id='r-70m8ztuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-70351402',owner_user_name='tempest-DeleteServersTestJSON-70351402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:12Z,user_data=None,user_id='aa6ac420579348c284a33443abac5250',uuid=78756f9d-416d-4bb5-a50b-f7401d3789c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:18.036124 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converting VIF {"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:18.036923 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:18.037836 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lazy-loading 'pci_devices' on Instance uuid 78756f9d-416d-4bb5-a50b-f7401d3789c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:18.042684 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:18.106735 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:18.231255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:18.231983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance network_info: |[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:18.236552 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start _get_guest_xml network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:18.236552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:18.236552 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Refreshing network info cache for port 809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:18.249413 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:18.250694 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-273864534', uuid='b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'), owner=OwnerMeta(userid='bd70e26fc3b243ffb390cf119334c5e6', username='tempest-ServerActionsTestOtherB-315226471-project-member', projectid='fc72b1dff20e43d1b244280499fc5f65', projectname='tempest-ServerActionsTestOtherB-315226471'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441618.2503214) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:18.254829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:18.255419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:18.256527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:18.257361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:18.257677 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:18.258127 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:18.258267 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:18.258360 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:18.258470 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:18.258575 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:18.258667 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:18.258837 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:18.258947 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:18.259053 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:18.259152 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:18.259259 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:18.281408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:18.284579 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:18.285325 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:18.285996 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'pci_devices' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:18.506700 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <uuid>78756f9d-416d-4bb5-a50b-f7401d3789c2</uuid>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <name>instance-00000001</name>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:name>tempest-DeleteServersTestJSON-server-678791422</nova:name>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:18</nova:creationTime>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:user uuid="aa6ac420579348c284a33443abac5250">tempest-DeleteServersTestJSON-70351402-project-member</nova:user>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:project uuid="7249714268a84dc2942c668f4096bb5b">tempest-DeleteServersTestJSON-70351402</nova:project>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         <nova:port uuid="55c855da-4062-4f73-8b16-5c7716de5da5">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="serial">78756f9d-416d-4bb5-a50b-f7401d3789c2</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="uuid">78756f9d-416d-4bb5-a50b-f7401d3789c2</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.config"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:20:6b:08"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <target dev="tap55c855da-40"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/console.log" append="off"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:18.540898 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:18.543040 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Preparing to wait for external event network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:18.543040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:18.543040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:18.543040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:18.543040 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-678791422',display_name='tempest-DeleteServersTestJSON-server-678791422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-deleteserverstestjson-server-678791422',id=1,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7249714268a84dc2942c668f4096bb5b',ramdisk_id='',reservation_id='r-70m8ztuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-70351402',owner_user_name='tempest-DeleteServersTestJSON-70351402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:12Z,user_data=None,user_id='aa6ac420579348c284a33443abac5250',uuid=78756f9d-416d-4bb5-a50b-f7401d3789c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:18.543215 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converting VIF {"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:18.544195 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:18.544195 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:18.586307 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Created schema index Interface.name {{(pid=98991) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 26 02:40:18.586443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Created schema index Port.name {{(pid=98991) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 26 02:40:18.588318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Created schema index Bridge.name {{(pid=98991) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 26 02:40:18.588318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:40:18.588318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [POLLOUT] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.588318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:40:18.588318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.589731 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.609904 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:18.613354 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.630489 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.630791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:18.631288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:18.632255 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.632453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f5db85b-2a1b-5e82-8036-43a397bd8fe3', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:18.633285 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.634169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:18.635512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.637076 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkqssxwxi/privsep.sock']
Jun 26 02:40:18.637320 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.643416 np0000003683 sudo[110730]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkqssxwxi/privsep.sock
Jun 26 02:40:18.644039 np0000003683 sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 26 02:40:18.745335 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <uuid>b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</uuid>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <name>instance-00000002</name>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherB-server-273864534</nova:name>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:18</nova:creationTime>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:user uuid="bd70e26fc3b243ffb390cf119334c5e6">tempest-ServerActionsTestOtherB-315226471-project-member</nova:user>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:project uuid="fc72b1dff20e43d1b244280499fc5f65">tempest-ServerActionsTestOtherB-315226471</nova:project>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         <nova:port uuid="809bd0a4-ea36-4c23-a2fd-5cfa28760410">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="serial">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="uuid">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:45:8c:a8"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <target dev="tap809bd0a4-ea"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/console.log" append="off"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Preparing to wait for external event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:18.792126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:18.793998 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:18.793998 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:18.793998 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:18.794184 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:18.794184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.794184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:18.794184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:18.795348 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.795492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '862b515f-9e0c-5c32-8d91-b062ba724b81', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:18.796127 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.796681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:18.796791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:18.896314 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 26 02:40:18.896428 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:18.896704 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:18.896704 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:18.896789 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:18.896915 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:18.896963 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:18.896963 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:18.897026 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 26 02:40:19.112434 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0358765-98bf-4927-be06-b14e0f5d6976 req-a7fbd139-0b01-4eec-9c96-8a6267868472 service nova] Releasing lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:19.113885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:19.113885 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:19.131512 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:19.180189 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:19.233762 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:19.234188 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 26 02:40:19.267137 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Updated VIF entry in instance network info cache for port 55c855da-4062-4f73-8b16-5c7716de5da5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:19.267385 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Updating instance_info_cache with network_info: [{"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:19.311067 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updated VIF entry in instance network info cache for port 809bd0a4-ea36-4c23-a2fd-5cfa28760410. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:19.311366 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:19.463380 np0000003683 sudo[110730]: pam_unix(sudo:session): session closed for user root
Jun 26 02:40:19.465080 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Spawned new privsep daemon via rootwrap
Jun 26 02:40:19.466107 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 26 02:40:19.466227 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 26 02:40:19.466299 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jun 26 02:40:19.466359 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110752
Jun 26 02:40:19.467050 np0000003683 nova-compute[98991]: WARNING oslo_privsep.priv_context [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] privsep daemon already running
Jun 26 02:40:19.679792 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:19.732430 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:19.732665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55c855da-40, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.733035 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55c855da-40, col_values=(('qos', UUID('070aa6a4-c1ba-40fb-b862-639fbcac5491')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.734037 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55c855da-40, col_values=(('external_ids', {'iface-id': '55c855da-4062-4f73-8b16-5c7716de5da5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6b:08', 'vm-uuid': '78756f9d-416d-4bb5-a50b-f7401d3789c2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.734960 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:19.736439 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:19.741257 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:19.741791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:19.741903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809bd0a4-ea, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.742140 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap809bd0a4-ea, col_values=(('qos', UUID('91d248e3-0279-424b-98ee-e268ce6d1e32')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.742250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap809bd0a4-ea, col_values=(('external_ids', {'iface-id': '809bd0a4-ea36-4c23-a2fd-5cfa28760410', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:8c:a8', 'vm-uuid': 'b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:19.743090 np0000003683 nova-compute[98991]: INFO os_vif [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40')
Jun 26 02:40:19.744502 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:19.753757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:19.755098 np0000003683 nova-compute[98991]: INFO os_vif [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:40:19.777210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16c76af2-2b28-404f-a14d-169beaf3f7c4 req-13b63688-ad76-4d5b-8911-af19289327ae service nova] Releasing lock "refresh_cache-78756f9d-416d-4bb5-a50b-f7401d3789c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:19.804845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:19.804997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:19.813499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b851e687-3b53-42b1-8fa2-fe149bbdc884 req-1f080153-2320-4c4f-802a-257e2a658cc5 service nova] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:19.915994 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:20.052575 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updating instance_info_cache with network_info: [{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:20.147256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:20.147256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:20.251417 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:20.307424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:20.555030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:20.555309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance network_info: |[{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:20.556841 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Start _get_guest_xml network_info=[{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:20.558094 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:20.558994 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1919154611', uuid='5e673f64-351d-4b09-a3be-8316d3a50b5d'), owner=OwnerMeta(userid='bc748533ff1b49ecbfc2f8e239350cea', username='tempest-ServerActionsTestOtherA-1295549616-project-member', projectid='f3004e12281740988b4f5119899f222b', projectname='tempest-ServerActionsTestOtherA-1295549616'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441620.5587494) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:20.559647 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:20.559953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:20.560780 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:20.560960 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:20.561608 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:20.561869 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:20.561996 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:20.562069 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:20.562234 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:20.562324 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:20.562409 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:20.562603 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:20.562701 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:20.562796 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:20.562903 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:20.563003 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:20.569208 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:20.571927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1919154611',display_name='tempest-ServerActionsTestOtherA-server-1919154611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-1919154611',id=3,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-5ussn8ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=5e673f64-351d-4b09-a3be-8316d3a50b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:20.572064 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:20.572622 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:20.572891 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e673f64-351d-4b09-a3be-8316d3a50b5d {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:20.648668 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:20.867510 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:20.868173 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:20.870687 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:20.870842 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Claim successful on node np0000003683
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <uuid>5e673f64-351d-4b09-a3be-8316d3a50b5d</uuid>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <name>instance-00000003</name>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherA-server-1919154611</nova:name>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:20</nova:creationTime>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:user uuid="bc748533ff1b49ecbfc2f8e239350cea">tempest-ServerActionsTestOtherA-1295549616-project-member</nova:user>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:project uuid="f3004e12281740988b4f5119899f222b">tempest-ServerActionsTestOtherA-1295549616</nova:project>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         <nova:port uuid="5279d472-fd5f-40b3-9130-196439442d5b">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="serial">5e673f64-351d-4b09-a3be-8316d3a50b5d</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="uuid">5e673f64-351d-4b09-a3be-8316d3a50b5d</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.config"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:bf:32:cc"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <target dev="tap5279d472-fd"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/console.log" append="off"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:21.077586 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:21.079426 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Preparing to wait for external event network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:21.079426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:21.079426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:21.079426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:21.079426 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1919154611',display_name='tempest-ServerActionsTestOtherA-server-1919154611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-1919154611',id=3,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-5ussn8ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=5e673f64-351d-4b09-a3be-8316d3a50b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:21.079718 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:21.080184 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:21.080362 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:21.080704 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.080928 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:21.081322 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:21.081700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.081892 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca4812a6-b972-5eed-a8cb-f50dac7602dc', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:21.082580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.083211 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:21.093819 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.096206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.096374 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5279d472-fd, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:21.096814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5279d472-fd, col_values=(('qos', UUID('12a72208-dbba-4f7e-a67f-fba2e5693007')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:21.096814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5279d472-fd, col_values=(('external_ids', {'iface-id': '5279d472-fd5f-40b3-9130-196439442d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:32:cc', 'vm-uuid': '5e673f64-351d-4b09-a3be-8316d3a50b5d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:21.097554 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.098506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:21.114741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.115708 np0000003683 nova-compute[98991]: INFO os_vif [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd')
Jun 26 02:40:21.159336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:21.160523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:21.203670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:21.264712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:21.264712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:21.264712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No VIF found with MAC fa:16:3e:20:6b:08, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:21.265258 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Using config drive
Jun 26 02:40:21.274199 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:21.274199 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:21.274199 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No VIF found with MAC fa:16:3e:45:8c:a8, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:21.274199 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Using config drive
Jun 26 02:40:21.456764 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:21.665396 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:21.770459 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:21.780726 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:22.052638 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Creating config drive at /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config
Jun 26 02:40:22.057964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe3ca5a_m {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:22.088652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe3ca5a_m" returned: 0 in 0.031s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:22.144554 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Creating config drive at /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.config
Jun 26 02:40:22.149251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1izdf3vd {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:22.182708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1izdf3vd" returned: 0 in 0.033s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:22.230517 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:22.258646 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:22.258949 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:22.635527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:22.635527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:22.635527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:bf:32:cc, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:22.636076 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Using config drive
Jun 26 02:40:22.673239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:22.676134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:22.676317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:22.676461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:22.676658 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No event matching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 in dict_keys([('network-vif-plugged', '809bd0a4-ea36-4c23-a2fd-5cfa28760410')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:40:22.676837 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4be136fc-21d7-465c-92a4-f75b6c57c13e req-457885d0-39ae-42db-a388-3b7ed7766cd8 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state building and task_state spawning.
Jun 26 02:40:22.763207 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:22.846411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:22.874292 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:22.955134 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:22.979864 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.067007 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.089753 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.141985 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:23.237630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.270587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.403s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:23.271322 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:23.274030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.070s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:23.277728 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:23.277877 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Claim successful on node np0000003683
Jun 26 02:40:23.279959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.328904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.384864 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Creating config drive at /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.config
Jun 26 02:40:23.389729 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzqrfgdty {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:23.418347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzqrfgdty" returned: 0 in 0.028s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:23.779574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:23.782415 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:23.782415 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:23.782415 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:23.939096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:23.959801 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c3fb774f434487eae3283b5aef0251f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaae08be6c14d52b705eb1c0bb160bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:23.960939 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:24.001646 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782441623.9989285, 78756f9d-416d-4bb5-a50b-f7401d3789c2 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:24.001646 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] VM Started (Lifecycle Event)
Jun 26 02:40:24.061431 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:24.291129 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:24.318767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received event network-vif-unplugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:24.319105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:24.319339 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:24.319534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:24.319723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] No event matching network-vif-unplugged-55c855da-4062-4f73-8b16-5c7716de5da5 in dict_keys([('network-vif-plugged', '55c855da-4062-4f73-8b16-5c7716de5da5')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:40:24.321107 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-37fcb8bd-efea-404f-ab9b-5e0cd452a486 req-d350ab1c-84e8-403a-9978-26dfdf973f51 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received unexpected event network-vif-unplugged-55c855da-4062-4f73-8b16-5c7716de5da5 for instance with vm_state building and task_state spawning.
Jun 26 02:40:24.505009 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:24.510550 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441624.5102022, 78756f9d-416d-4bb5-a50b-f7401d3789c2 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:24.510720 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] VM Paused (Lifecycle Event)
Jun 26 02:40:24.664842 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Successfully created port: bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:24.737506 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:24.737804 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:24.775965 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:24.776206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:24.776632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:24.776632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:24.776786 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] No event matching network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b in dict_keys([('network-vif-plugged', '5279d472-fd5f-40b3-9130-196439442d5b')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:40:24.776942 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received unexpected event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b for instance with vm_state building and task_state spawning.
Jun 26 02:40:24.777068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:24.777233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:24.777405 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:24.777935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:24.777984 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-950de83d-5e8c-4fa7-a3e2-c8c04de04b04 req-fd3774db-17f7-4755-968a-e944497b0bff service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Processing event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:24.778444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:24.783253 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:24.790114 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance spawned successfully.
Jun 26 02:40:24.790512 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:24.793799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:25.013235 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:25.014972 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:25.241038 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:25.307659 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Successfully updated port: bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:25.315664 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.315795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.316137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.316373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.316665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.316919 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:25.377194 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:25.377356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:25.377531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:25.377925 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:25.378052 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] No waiting events found dispatching network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:25.378175 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c086acbe-8aed-4ce7-9b3c-d96231dacb2b req-45d01ebc-85c5-4f97-a743-2fa355b9878c service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received unexpected event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c for instance with vm_state building and task_state spawning.
Jun 26 02:40:25.519329 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:25.519608 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441625.5193846, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:25.519746 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Started (Lifecycle Event)
Jun 26 02:40:25.752587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.479s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:25.753404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.523s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:25.753619 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:25.757788 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:25.757925 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Claim successful on node np0000003683
Jun 26 02:40:25.772435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:25.774997 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:25.776069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:25.780083 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:25.793321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:25.809924 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:25.810688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:25.810902 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Creating image(s)
Jun 26 02:40:25.811279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:25.811417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:25.811855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:25.812310 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:25.817966 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:25.819350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:25.819350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquired lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:25.820088 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:25.821147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:25.832663 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Took 10.90 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:25.836540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:25.886386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:25.887033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:25.887033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:25.891208 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:25.896707 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:25.898104 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:25.977974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:25.978458 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:26.010586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk 1073741824" returned: 0 in 0.032s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:26.011142 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.124s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.011455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:26.020688 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.024753 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:26.028555 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:26.089967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.078s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:26.090375 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:26.090650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:26.105213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.154905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:26.155581 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Cannot resize image /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:26.156296 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:26.156823 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Ensure instance console log exists: /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:26.156901 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.157156 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.157329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.272120 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:26.272383 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:26.272930 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:26.273911 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:26.350534 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Took 17.12 seconds to build instance.
Jun 26 02:40:26.388271 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24f8637c0014a72b83f0b18bda326df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe57b3cf078f49879b9e2b586be5a31b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:26.447152 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:26.459992 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received event network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.460185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.460346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.460470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.460628 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Processing event network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:26.461720 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received event network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.465503 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.465503 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:26.465503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.465685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.465685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.465872 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] No waiting events found dispatching network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:26.465931 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received unexpected event network-vif-plugged-55c855da-4062-4f73-8b16-5c7716de5da5 for instance with vm_state building and task_state spawning.
Jun 26 02:40:26.466044 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-changed-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.466190 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Refreshing instance network info cache due to event network-changed-bdbfe460-92fa-4088-82b9-636d21ff447c. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:26.467256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Acquiring lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:26.470741 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:26.472321 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Instance spawned successfully.
Jun 26 02:40:26.472947 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:26.518583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.520898 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.524455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.535482 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441626.53517, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:26.536082 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Paused (Lifecycle Event)
Jun 26 02:40:26.542258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.705299 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:26.730925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:26.779382 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:26.853528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4568dea6-36bd-47cd-babe-6308d47180fd tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.631s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.863642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.863642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.863642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.864048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.864536 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:26.864750 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state active and task_state None.
Jun 26 02:40:26.864967 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.865232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.865800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.866145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.866348 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Processing event network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:26.866994 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:26.867505 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:26.868154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:26.868154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:26.868522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:26.868950 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] No waiting events found dispatching network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:26.868950 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e6cf4b6e-6e70-48d0-8412-c350dfd255ae req-d5bfdae3-2667-4e3c-af33-7ac9c2b0329f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received unexpected event network-vif-plugged-5279d472-fd5f-40b3-9130-196439442d5b for instance with vm_state building and task_state spawning.
Jun 26 02:40:26.872221 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:26.874291 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance spawned successfully.
Jun 26 02:40:26.875047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:26.922622 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updating instance_info_cache with network_info: [{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:26.989882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.039408 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:27.043787 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441627.0434625, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:27.044378 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Resumed (Lifecycle Event)
Jun 26 02:40:27.065583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.067734 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.087657 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.133377 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Successfully created port: 55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:27.287064 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:27.287496 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:27.295270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:27.383100 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.384305 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.384934 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.385788 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.387553 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.387553 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:27.425155 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Releasing lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:27.425155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Instance network_info: |[{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:27.425155 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Acquired lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:27.427684 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Refreshing network info cache for port bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:27.427952 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Start _get_guest_xml network_info=[{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:27.435446 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:27.436666 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1720807154', uuid='3e48fc5a-edf8-4497-8815-3430ef4d4391'), owner=OwnerMeta(userid='5c3fb774f434487eae3283b5aef0251f', username='tempest-VolumesAssistedSnapshotsTest-345586448-project-member', projectid='5eaae08be6c14d52b705eb1c0bb160bf', projectname='tempest-VolumesAssistedSnapshotsTest-345586448'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441627.4362302) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:27.439758 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:27.440714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:27.441889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:27.442151 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:27.443286 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:27.443774 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:27.443944 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:27.444058 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:27.444195 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:27.444285 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:27.444387 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:27.444607 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:27.444681 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:27.445304 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:27.445304 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:27.445304 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:27.460047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1720807154',display_name='tempest-VolumesAssistedSnapshotsTest-server-1720807154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesassistedsnapshotstest-server-1720807154',id=4,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGqgJEZiBZAROjdBye9W1VCG2OQfiNIYgxc7W2d6SaE9371JZTo2Aq++O9KnKtDv9jZshSf9iks7qEmzWE3SgUeIBRvc1KdqHNzidh7np6Z1tw8U96Vdo/7DAPSz3QiIQ==',key_name='tempest-keypair-702548744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eaae08be6c14d52b705eb1c0bb160bf',ramdisk_id='',reservation_id='r-4qt5ciwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-345586448',owner_user_name='tempest-VolumesAssistedSnapshotsTest-345586448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fb774f434487eae3283b5aef0251f',uuid=3e48fc5a-edf8-4497-8815-3430ef4d4391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:27.460229 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converting VIF {"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:27.460938 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:27.461515 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:27.501185 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Took 14.82 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:27.501185 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:27.549978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:27.551515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:27.790426 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:27.815273 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Successfully updated port: 55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:27.894554 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Took 10.63 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:27.895031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:27.914594 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-changed-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:27.916663 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Refreshing instance network info cache due to event network-changed-809bd0a4-ea36-4c23-a2fd-5cfa28760410. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:27.917023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:27.917766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:27.917994 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Refreshing network info cache for port 809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:27.932966 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <uuid>3e48fc5a-edf8-4497-8815-3430ef4d4391</uuid>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <name>instance-00000004</name>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1720807154</nova:name>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:27</nova:creationTime>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:user uuid="5c3fb774f434487eae3283b5aef0251f">tempest-VolumesAssistedSnapshotsTest-345586448-project-member</nova:user>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:project uuid="5eaae08be6c14d52b705eb1c0bb160bf">tempest-VolumesAssistedSnapshotsTest-345586448</nova:project>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         <nova:port uuid="bdbfe460-92fa-4088-82b9-636d21ff447c">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="serial">3e48fc5a-edf8-4497-8815-3430ef4d4391</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="uuid">3e48fc5a-edf8-4497-8815-3430ef4d4391</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.config"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:22:69:18"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <target dev="tapbdbfe460-92"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/console.log" append="off"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Preparing to wait for external event network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:27.964715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:27.969809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:27.969809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:27.969809 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1720807154',display_name='tempest-VolumesAssistedSnapshotsTest-server-1720807154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesassistedsnapshotstest-server-1720807154',id=4,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGqgJEZiBZAROjdBye9W1VCG2OQfiNIYgxc7W2d6SaE9371JZTo2Aq++O9KnKtDv9jZshSf9iks7qEmzWE3SgUeIBRvc1KdqHNzidh7np6Z1tw8U96Vdo/7DAPSz3QiIQ==',key_name='tempest-keypair-702548744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eaae08be6c14d52b705eb1c0bb160bf',ramdisk_id='',reservation_id='r-4qt5ciwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-345586448',owner_user_name='tempest-VolumesAssistedSnapshotsTest-345586448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fb774f434487eae3283b5aef0251f',uuid=3e48fc5a-edf8-4497-8815-3430ef4d4391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converting VIF {"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.971044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56ee6790-b1ec-5808-b87f-ab40645cdd32', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:27.971912 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.972981 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:27.975000 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.983293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.983293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdbfe460-92, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:27.983293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdbfe460-92, col_values=(('qos', UUID('56fb2415-41c5-46d4-810c-d01cdb47482f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:27.983885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdbfe460-92, col_values=(('external_ids', {'iface-id': 'bdbfe460-92fa-4088-82b9-636d21ff447c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:69:18', 'vm-uuid': '3e48fc5a-edf8-4497-8815-3430ef4d4391'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:27.986606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.988162 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:27.992030 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:27.993238 np0000003683 nova-compute[98991]: INFO os_vif [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92')
Jun 26 02:40:28.015550 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Took 20.17 seconds to build instance.
Jun 26 02:40:28.054172 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441628.0537071, 5e673f64-351d-4b09-a3be-8316d3a50b5d => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:28.054295 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] VM Started (Lifecycle Event)
Jun 26 02:40:28.265891 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-changed-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:28.266034 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Refreshing instance network info cache due to event network-changed-55dfb6d2-becd-46d5-a95c-f02d0d21eadb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:28.267781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] Acquiring lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:28.267933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] Acquired lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:28.271501 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Refreshing network info cache for port 55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:28.300718 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.548s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:28.301004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:28.306297 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:28.307121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:28.307365 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Creating image(s)
Jun 26 02:40:28.307782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:28.307937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:28.308351 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:28.315795 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.318145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:28.318528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:28.318866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:28.405124 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Took 19.01 seconds to build instance.
Jun 26 02:40:28.421627 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.521062 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d8ac9281-d3e6-421e-b955-76c2efc2c3a5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.689s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:28.548648 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updated VIF entry in instance network info cache for port bdbfe460-92fa-4088-82b9-636d21ff447c. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:28.548950 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updating instance_info_cache with network_info: [{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:28.556503 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:28.558488 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:28.770087 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.798653 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.806506 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:28.806696 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:28.806900 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.807089 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:28.895430 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:28.907904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b7f2dba7-5a93-4ac6-be69-33a3b927360a tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.523s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:28.946215 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a64b2d42a9c4039ac9d0a0bb79b951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c96beaf0646b38621c7b79c2968bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:29.052275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50e41114-3412-4041-b478-ac8a5e5d2939 req-ac815607-dda1-4ea3-a995-e4c5e68483c1 service nova] Releasing lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:29.061381 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441629.0610695, 5e673f64-351d-4b09-a3be-8316d3a50b5d => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:29.061756 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] VM Paused (Lifecycle Event)
Jun 26 02:40:29.068038 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updated VIF entry in instance network info cache for port 809bd0a4-ea36-4c23-a2fd-5cfa28760410. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:29.068300 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:29.138636 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:29.313383 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:29.316808 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.321062 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.321830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.398374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.part --force-share --output=json" returned: 0 in 0.076s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.398866 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] bacaf0fe-7ee9-4f00-af1d-8cb159bfd225 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:40:29.399676 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:40:29.399927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.part /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.525038 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:29.527611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:29.527611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] No VIF found with MAC fa:16:3e:22:69:18, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:29.528371 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Using config drive
Jun 26 02:40:29.555929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:29.556178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:29.566454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:29.569572 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441629.5691004, 78756f9d-416d-4bb5-a50b-f7401d3789c2 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:29.569796 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] VM Resumed (Lifecycle Event)
Jun 26 02:40:29.575463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-353eae8e-7f8a-474d-8c00-73840390d3e5 req-0f2c8059-7b90-4a0f-bf7d-08bb564a2729 service nova] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:29.629503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.part /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.converted" returned: 0 in 0.229s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.639013 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.655275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d041a1d-ee3d-42a8-9745-732b57876236 req-3cc969f8-a56a-4b75-949b-ab09b5e376db service nova] Releasing lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:29.657992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquired lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:29.658045 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:29.729746 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.734989 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Successfully created port: 757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:29.738803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.420s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:29.740648 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.745234 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.746643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.823865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:29.828173 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json" returned: 0 in 0.081s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.831108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:29.831108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:29.831108 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.838174 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:29.839265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.930535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.931021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8,backing_fmt=raw /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:29.970464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8,backing_fmt=raw /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk 1073741824" returned: 0 in 0.039s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:29.970959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "5adc59fb536d5675288eb0dbab69998d7efd69a8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:29.971266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:30.044262 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:30.049713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5adc59fb536d5675288eb0dbab69998d7efd69a8 --force-share --output=json" returned: 0 in 0.078s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:30.053542 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:30.053542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:30.067373 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lazy-loading 'flavor' on Instance uuid 78756f9d-416d-4bb5-a50b-f7401d3789c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:30.074935 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:30.078540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Cannot resize image /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Ensure instance console log exists: /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:30.129120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:30.256261 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:30.279079 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Creating config drive at /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.config
Jun 26 02:40:30.283372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp880g1spc {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:30.314766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp880g1spc" returned: 0 in 0.031s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:30.345167 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Booting with volume 58960a13-863b-468a-adc1-8bc8e1ea5fac at /dev/vda
Jun 26 02:40:30.355522 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-changed-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:30.355799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing instance network info cache due to event network-changed-5279d472-fd5f-40b3-9130-196439442d5b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:30.356117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] Acquiring lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:30.356356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] Acquired lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:30.357061 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing network info cache for port 5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:30.397512 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Successfully updated port: 757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:30.414842 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:40:30.414842 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpvkq6uxdq/privsep.sock']
Jun 26 02:40:30.424325 np0000003683 sudo[111310]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpvkq6uxdq/privsep.sock
Jun 26 02:40:30.425102 np0000003683 sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 26 02:40:30.452067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-changed-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:30.452402 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Refreshing instance network info cache due to event network-changed-757fd1af-c79d-456e-b641-1382ec7a0b5a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:30.452649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] Acquiring lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:30.452975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] Acquired lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:30.452975 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Refreshing network info cache for port 757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:30.509906 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:30.581803 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441630.5814416, 5e673f64-351d-4b09-a3be-8316d3a50b5d => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:30.582027 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] VM Resumed (Lifecycle Event)
Jun 26 02:40:30.673106 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updating instance_info_cache with network_info: [{"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:30.682036 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 26 02:40:30.682156 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:30.682156 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:30.682220 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:30.682249 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:30.682304 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:30.682347 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:30.682378 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:30.682422 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 26 02:40:30.815109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:30.846929 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:30.859803 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:30.903030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:30.958244 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:30.960779 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.028769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f5d71b1e-532b-497e-8abc-4b05c671a30f req-3914742b-a38e-45df-997f-740de3952bdd service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:31.028769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5d71b1e-532b-497e-8abc-4b05c671a30f req-3914742b-a38e-45df-997f-740de3952bdd service nova] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:31.028769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5d71b1e-532b-497e-8abc-4b05c671a30f req-3914742b-a38e-45df-997f-740de3952bdd service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:31.028769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5d71b1e-532b-497e-8abc-4b05c671a30f req-3914742b-a38e-45df-997f-740de3952bdd service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:31.028769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f5d71b1e-532b-497e-8abc-4b05c671a30f req-3914742b-a38e-45df-997f-740de3952bdd service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Processing event network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:31.040073 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 26 02:40:31.040199 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 26 02:40:31.040311 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 26 02:40:31.040450 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:31.040505 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 26 02:40:31.040628 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 26 02:40:31.040673 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 26 02:40:31.040773 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 26 02:40:31.040812 np0000003683 nova-compute[98991]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 26 02:40:31.056812 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:31.075506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:31.087419 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:31.090752 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:31.175732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Releasing lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:31.176174 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance network_info: |[{"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:31.179026 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Start _get_guest_xml network_info=[{"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:40:13Z,direct_url=<?>,disk_format='qcow2',id=bacaf0fe-7ee9-4f00-af1d-8cb159bfd225,min_disk=0,min_ram=0,name='',owner='822f0568224844098e63942297e520ea',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:40:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'bacaf0fe-7ee9-4f00-af1d-8cb159bfd225'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:31.183206 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:31.184952 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1071513237', uuid='6cf8d36a-f984-44ac-8c51-7cda57e1afa3'), owner=OwnerMeta(userid='f24f8637c0014a72b83f0b18bda326df', username='tempest-AttachSCSIVolumeTestJSON-1987838335-project-member', projectid='fe57b3cf078f49879b9e2b586be5a31b', projectname='tempest-AttachSCSIVolumeTestJSON-1987838335'), image=ImageMeta(id='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441631.1844277) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:31.192545 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:31.199391 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:31.201509 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:31.201998 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:31.203681 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:31.203681 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:40:13Z,direct_url=<?>,disk_format='qcow2',id=bacaf0fe-7ee9-4f00-af1d-8cb159bfd225,min_disk=0,min_ram=0,name='',owner='822f0568224844098e63942297e520ea',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:40:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:31.204071 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:31.204071 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:31.204296 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:31.204358 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:31.204520 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:31.204806 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:31.204885 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:31.205003 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:31.205148 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:31.205272 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:31.221007 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1071513237',display_name='tempest-AttachSCSIVolumeTestJSON-server-1071513237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachscsivolumetestjson-server-1071513237',id=5,image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdFTWZWsGITP5rtIeGL0d4qFOFm4vy2/AStH30gc9fQVB5bk3LySiDtt/Dg3ufE5jhPqa78f8gWOau9KQX/P94OJRRueR3jSRThluUhdQeieyYrKwHzRnj3SNbgeozw1A==',key_name='tempest-keypair-1977725589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe57b3cf078f49879b9e2b586be5a31b',ramdisk_id='',reservation_id='r-3k10a3jf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1987838335',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1987838335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24f8637c0014a72b83f0b18bda326df',uuid=6cf8d36a-f984-44ac-8c51-7cda57e1afa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:31.221276 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converting VIF {"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:31.222141 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:31.222865 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:31.247685 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.250376 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.261834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.281618 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.335939 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:31.340405 np0000003683 sudo[111310]: pam_unix(sudo:session): session closed for user root
Jun 26 02:40:31.341863 np0000003683 nova-compute[98991]: INFO oslo.privsep.daemon [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Spawned new privsep daemon via rootwrap
Jun 26 02:40:31.394503 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:31.462243 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.467693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:40:31.468142 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.nvmeof [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jun 26 02:40:31.490213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:31.509552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:40:31.509799 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:40:31.519366 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:40:31.522342 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:fe20:6b08', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::5470:d1ff:fe80:f889', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c'] 
Jun 26 02:40:31.522509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:40:31.522566 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:40:31.523258 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== get_connector_properties: return (1109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:40:31.523452 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating existing volume attachment record: e660f244-a0e2-453d-bed0-3b998d9d77d0 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:40:31.580237 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updated VIF entry in instance network info cache for port 5279d472-fd5f-40b3-9130-196439442d5b. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:31.580237 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updating instance_info_cache with network_info: [{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <uuid>6cf8d36a-f984-44ac-8c51-7cda57e1afa3</uuid>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <name>instance-00000005</name>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1071513237</nova:name>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:31</nova:creationTime>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:image uuid="bacaf0fe-7ee9-4f00-af1d-8cb159bfd225">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">scsi</nova:property>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:user uuid="f24f8637c0014a72b83f0b18bda326df">tempest-AttachSCSIVolumeTestJSON-1987838335-project-member</nova:user>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:project uuid="fe57b3cf078f49879b9e2b586be5a31b">tempest-AttachSCSIVolumeTestJSON-1987838335</nova:project>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="bacaf0fe-7ee9-4f00-af1d-8cb159bfd225"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         <nova:port uuid="55dfb6d2-becd-46d5-a95c-f02d0d21eadb">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="serial">6cf8d36a-f984-44ac-8c51-7cda57e1afa3</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="uuid">6cf8d36a-f984-44ac-8c51-7cda57e1afa3</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <target dev="sda" bus="scsi"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <address type="drive" controller="0" unit="0"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.config"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <target dev="sdb" bus="scsi"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <address type="drive" controller="0" unit="1"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:6c:57:cd"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <target dev="tap55dfb6d2-be"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/console.log" append="off"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:31.727983 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:31.733887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Preparing to wait for external event network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:31.733887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:31.733887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:31.733887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:31.733887 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1071513237',display_name='tempest-AttachSCSIVolumeTestJSON-server-1071513237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachscsivolumetestjson-server-1071513237',id=5,image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdFTWZWsGITP5rtIeGL0d4qFOFm4vy2/AStH30gc9fQVB5bk3LySiDtt/Dg3ufE5jhPqa78f8gWOau9KQX/P94OJRRueR3jSRThluUhdQeieyYrKwHzRnj3SNbgeozw1A==',key_name='tempest-keypair-1977725589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe57b3cf078f49879b9e2b586be5a31b',ramdisk_id='',reservation_id='r-3k10a3jf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1987838335',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1987838335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24f8637c0014a72b83f0b18bda326df',uuid=6cf8d36a-f984-44ac-8c51-7cda57e1afa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:31.734353 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converting VIF {"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:31.734353 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:31.734353 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:31.734995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.735386 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:31.735789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:31.736761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.736875 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3936651-1891-573e-b50f-b759b618f5cd', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:31.738050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.738764 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:31.739917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.742157 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.742325 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55dfb6d2-be, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:31.742735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55dfb6d2-be, col_values=(('qos', UUID('eeb6b736-311d-45c9-a05c-cf1aaeb0fa6d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:31.742923 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55dfb6d2-be, col_values=(('external_ids', {'iface-id': '55dfb6d2-becd-46d5-a95c-f02d0d21eadb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:57:cd', 'vm-uuid': '6cf8d36a-f984-44ac-8c51-7cda57e1afa3'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:31.743713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.745020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:31.750491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:31.751872 np0000003683 nova-compute[98991]: INFO os_vif [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be')
Jun 26 02:40:31.837032 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:31.837240 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441631.8369706, 3e48fc5a-edf8-4497-8815-3430ef4d4391 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:31.837395 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] VM Started (Lifecycle Event)
Jun 26 02:40:31.843990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9cb7cd9d-0e87-48b0-8c1c-86d1c3516eaa req-c57069b0-7508-4d44-9627-1162e6b64567 service nova] Releasing lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:31.844611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:31.845394 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquired lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:31.845644 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:31.854663 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Instance spawned successfully.
Jun 26 02:40:31.855066 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:32.082350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d6da23a-8aab-42d7-9ff9-43d1232dfcf4 req-cff76fc6-4bab-446e-b901-2b4b11333815 service nova] Releasing lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:32.352073 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:32.357272 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:32.361488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.361637 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.361927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.362149 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.362434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.362711 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:32.435259 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:32.628443 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:32.662133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:32.662354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:32.662607 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Attaching volume 7276208e-6e85-482c-9b82-502ded1432fd to /dev/vdb
Jun 26 02:40:32.731208 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:40:32.743238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:40:32.770960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:32.796256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:40:32.796693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:40:32.806656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:40:32.808236 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:fe20:6b08', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::5470:d1ff:fe80:f889', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c'] 
Jun 26 02:40:32.808571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:40:32.810507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:40:32.810507 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:40:32.810507 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Updating existing volume attachment record: 815c800a-5937-4a7d-b696-23e7dfd4ace6 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:40:32.815806 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating instance_info_cache with network_info: [{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:32.860337 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:32.860337 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441632.8600993, 3e48fc5a-edf8-4497-8815-3430ef4d4391 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:32.860665 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] VM Paused (Lifecycle Event)
Jun 26 02:40:32.869839 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Took 7.06 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:32.870357 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:33.105941 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:33.106491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:33.106540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:33.106960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:33.106960 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] No waiting events found dispatching network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:33.107069 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-07e31dd8-8343-4800-b813-38bfa160ad5d req-235bedc9-dfe1-47cf-9bd9-86ab9e0a550d service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received unexpected event network-vif-plugged-bdbfe460-92fa-4088-82b9-636d21ff447c for instance with vm_state active and task_state None.
Jun 26 02:40:33.270610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No BDM found with device name sda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:33.270770 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:33.270941 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No VIF found with MAC fa:16:3e:6c:57:cd, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:33.272045 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Using config drive
Jun 26 02:40:33.319888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Releasing lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:33.322416 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance network_info: |[{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:33.365525 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:33.367360 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441633.3670511, 3e48fc5a-edf8-4497-8815-3430ef4d4391 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:33.367464 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] VM Resumed (Lifecycle Event)
Jun 26 02:40:33.382499 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Took 12.57 seconds to build instance.
Jun 26 02:40:33.420514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:33.420514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:33.420514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connector [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Factory for ISCSI on None {{(pid=98991) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
Jun 26 02:40:33.421507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:33.421795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:40:33.422536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:40:33.423080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:33.423665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:33.425225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:40:33.437828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:33.438458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:33.438968 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:33.439095 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:40:33.439541 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:33.439723 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:40:33.451070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:40:33.451070 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:33.451832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:40:33.451832 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd] added
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:33.460547 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:33.460804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:40:33.460932 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:40:33.461285 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd] added
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:33.464962 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:33.465173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:40:33.465232 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:40:33.465354 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:40:33.718376 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:33.719706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:33.719995 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating image(s)
Jun 26 02:40:33.720342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:40:33.720526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Ensure instance console log exists: /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:33.720760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:33.721048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:33.721214 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:33.721646 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start _get_guest_xml network_info=[{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e660f244-a0e2-453d-bed0-3b998d9d77d0', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0c96a877-c722-4f5d-b621-6d2993d7ad69', 'attached_at': '', 'detached_at': '', 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'serial': '58960a13-863b-468a-adc1-8bc8e1ea5fac'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:33.723928 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:33.725275 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1874603748', uuid='0c96a877-c722-4f5d-b621-6d2993d7ad69'), owner=OwnerMeta(userid='3a64b2d42a9c4039ac9d0a0bb79b951a', username='tempest-ServerActionsV293TestJSON-213768761-project-member', projectid='604c96beaf0646b38621c7b79c2968bd', projectname='tempest-ServerActionsV293TestJSON-213768761'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441633.7249455) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:33.726390 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:33.726814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:33.727982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:33.727982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:33.729168 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:33.729499 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:33.729649 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:33.729765 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:33.729914 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:33.730020 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:33.730139 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:33.730275 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:33.730446 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:33.730517 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:33.730635 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:33.730778 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:33.746309 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:40:33.746627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:40:33.746799 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:33.781460 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:33.824668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:33.870066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:33.873719 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:33.885032 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4f951163-7500-41b4-8045-918127b6b289 tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.080s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:34.027409 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Creating config drive at /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.config
Jun 26 02:40:34.035118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp70g9jmnf {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:34.050534 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.080024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp70g9jmnf" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:34.461952 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:40:34.466727 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:40:34.473745 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:40:34.479948 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:34.490091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:34.502589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:40:34.509237 np0000003683 nova-compute[98991]: 
Jun 26 02:40:34.517061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:40:34.517061 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:34.517061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:40:34.517061 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:34.517531 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:40:34.517531 np0000003683 nova-compute[98991]: 
Jun 26 02:40:34.595389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.619995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.717653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.922924 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-changed-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:34.922924 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Refreshing instance network info cache due to event network-changed-bdbfe460-92fa-4088-82b9-636d21ff447c. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:34.922924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] Acquiring lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:34.922924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] Acquired lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:34.922924 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Refreshing network info cache for port bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:34.952053 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.956523 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.959619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:34.975798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:35.426861 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:35.553412 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441635.5529583, 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:35.553883 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] VM Started (Lifecycle Event)
Jun 26 02:40:35.556937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.50.100,3260]
Jun 26 02:40:35.556937 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.50.100,3260] successful.
Jun 26 02:40:35.556937 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:35.557882 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.40.100,3260]
Jun 26 02:40:35.557882 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.40.100,3260] successful.
Jun 26 02:40:35.557882 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:35.571906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:35.580089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:35.594379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.594379 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.594379 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:35.595038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.595038 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.595038 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:35.595038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:35.595208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:40:35.596173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:40:35.596338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:40:35.605095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.605095 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.605095 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:35.605438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.605438 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:35.605438 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:35.605777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.167s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:35.605961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:40:35.606559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:40:35.606705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:40:35.618253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:40:35.618253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:40:35.625642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:40:35.625642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:40:35.914240 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:36.056851 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:36.058364 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441636.0581295, 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:36.058464 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] VM Paused (Lifecycle Event)
Jun 26 02:40:36.095899 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updated VIF entry in instance network info cache for port bdbfe460-92fa-4088-82b9-636d21ff447c. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:36.096180 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updating instance_info_cache with network_info: [{"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:36.354665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:36.441592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:40:36.461763 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:36.561010 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:36.563201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:36.600505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-020804b1-33d5-4a5a-baa1-a87c21b9fe12 req-f0c8933e-de23-4b77-8828-e5d90151589b service nova] Releasing lock "refresh_cache-3e48fc5a-edf8-4497-8815-3430ef4d4391" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:36.758683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:36.989665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc2cfc12-43e9-4e70-9787-e2557788f6ab req-70941f9b-e73c-4e92-90c8-e886d131548d service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:36.990179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc2cfc12-43e9-4e70-9787-e2557788f6ab req-70941f9b-e73c-4e92-90c8-e886d131548d service nova] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:36.990179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc2cfc12-43e9-4e70-9787-e2557788f6ab req-70941f9b-e73c-4e92-90c8-e886d131548d service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:36.990242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc2cfc12-43e9-4e70-9787-e2557788f6ab req-70941f9b-e73c-4e92-90c8-e886d131548d service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:36.990583 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc2cfc12-43e9-4e70-9787-e2557788f6ab req-70941f9b-e73c-4e92-90c8-e886d131548d service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Processing event network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:36.990663 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:36.997159 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:37.002241 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance spawned successfully.
Jun 26 02:40:37.002241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:37.006285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:37.006285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:37.006285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:37.006285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:37.065587 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:37.065929 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441637.065708, 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:37.066066 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] VM Resumed (Lifecycle Event)
Jun 26 02:40:37.457660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Found WWN 3300000007cfcb9b7 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:40:37.457915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:37.458091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '3300000007cfcb9b7', 'path': '/dev/dm-0', 'multipath_id': '3300000007cfcb9b7'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:40:37.458353 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007cfcb9b7', 'path': '/dev/dm-0', 'multipath_id': '3300000007cfcb9b7'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:40:37.458717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.712s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:37.458965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:40:37.464519 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lazy-loading 'flavor' on Instance uuid 78756f9d-416d-4bb5-a50b-f7401d3789c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:37.471230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:37.471637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:37.472119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:37.472348 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:40:37.473105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:37.473446 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:40:37.486560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:40:37.486560 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:37.488403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:40:37.488403 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac] added
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:37.501885 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac] added
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:40:37.502428 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:37.502664 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:40:37.502924 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:40:37.503102 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:40:37.503491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:40:37.503896 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:40:37.504059 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:40:37.510464 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Took 9.20 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:37.510702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:37.568907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:37.572038 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:37.917606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:37.970198 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Attempting to attach volume 7276208e-6e85-482c-9b82-502ded1432fd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:   <alias name="ua-7276208e-6e85-482c-9b82-502ded1432fd"/>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:   <serial>7276208e-6e85-482c-9b82-502ded1432fd</serial>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:40:37.975918 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:40:38.018159 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Took 16.86 seconds to build instance.
Jun 26 02:40:38.075156 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:38.503558 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:40:38.505799 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:40:38.517515 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:40:38.525859 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.528781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-abe51a20-6c17-4d30-9afe-e51901f741d1 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.379s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:38.537122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.543992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.551213 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.551213 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.551213 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:38.551419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.551419 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.551419 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:38.558434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.558434 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.558434 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:38.558639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.558639 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.558639 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:38.588000 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260]
Jun 26 02:40:38.588000 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260] successful.
Jun 26 02:40:38.588000 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.600997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.614167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260]
Jun 26 02:40:38.614167 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260] successful.
Jun 26 02:40:38.614167 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:40:38.617563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:40:38.626804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:38.635698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:40:38.636145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:40:38.643357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.643357 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.643357 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.643357 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.643357 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:38.643798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.643798 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:38.643798 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.643798 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:38.643798 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:38.643920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:38.644089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:40:38.644859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:40:38.645032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:40:38.661397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:40:39.055744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:39.055922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:39.056114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:39.056452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:39.056624 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] No waiting events found dispatching network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:39.056772 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4aae65c2-e5d4-4e1e-9204-198f290fef15 req-231e5507-b840-4ed5-950d-9e908c9e6b33 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received unexpected event network-vif-plugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb for instance with vm_state active and task_state None.
Jun 26 02:40:39.111721 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-changed-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:39.112450 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Refreshing instance network info cache due to event network-changed-55dfb6d2-becd-46d5-a95c-f02d0d21eadb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:39.112670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] Acquiring lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:39.112770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] Acquired lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:39.112983 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Refreshing network info cache for port 55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:39.620026 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:39.658564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:39.658564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:39.658564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:39.658564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] No VIF found with MAC fa:16:3e:20:6b:08, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:39.661374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:40:39.661578 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:40:40.043037 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:40.195643 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updated VIF entry in instance network info cache for port 55dfb6d2-becd-46d5-a95c-f02d0d21eadb. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:40.196179 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updating instance_info_cache with network_info: [{"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:40.435886 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:40.494104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Found WWN 3300000006d49c7c2 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:40:40.494377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:40.494609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== connect_volume: return (6747ms) {'type': 'block', 'scsi_wwn': '3300000006d49c7c2', 'path': '/dev/dm-1', 'multipath_id': '3300000006d49c7c2'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:40:40.494778 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d49c7c2', 'path': '/dev/dm-1', 'multipath_id': '3300000006d49c7c2'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:40:40.698316 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5645d73f-84a1-4d38-b53f-8a36a1baaa37 req-b21d960b-0610-4d1b-9f3b-4ae353a7c2f7 service nova] Releasing lock "refresh_cache-6cf8d36a-f984-44ac-8c51-7cda57e1afa3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:41.004750 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1874603748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:41.005567 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:41.005567 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:41.008206 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c96a877-c722-4f5d-b621-6d2993d7ad69 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:41.221444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eea4065c-a126-4fde-8a33-189f0bd4f6b5 tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.559s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:41.463068 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <uuid>0c96a877-c722-4f5d-b621-6d2993d7ad69</uuid>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <name>instance-00000006</name>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1874603748</nova:name>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:33</nova:creationTime>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:user uuid="3a64b2d42a9c4039ac9d0a0bb79b951a">tempest-ServerActionsV293TestJSON-213768761-project-member</nova:user>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:project uuid="604c96beaf0646b38621c7b79c2968bd">tempest-ServerActionsV293TestJSON-213768761</nova:project>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         <nova:port uuid="757fd1af-c79d-456e-b641-1382ec7a0b5a">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="serial">0c96a877-c722-4f5d-b621-6d2993d7ad69</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="uuid">0c96a877-c722-4f5d-b621-6d2993d7ad69</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <alias name="ua-58960a13-863b-468a-adc1-8bc8e1ea5fac"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <serial>58960a13-863b-468a-adc1-8bc8e1ea5fac</serial>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:ef:93:bf"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <target dev="tap757fd1af-c7"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/console.log" append="off"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:41.518553 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:41.521077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Preparing to wait for external event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:41.521077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:41.521077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:41.521077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:41.521077 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1874603748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:41.521370 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:41.521370 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:41.521370 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:41.521370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.521850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:41.522088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:41.523244 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.523493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b37e8087-1b00-5866-92b8-dea455426ae8', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:41.524400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.525335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:41.527371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.529747 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.530039 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap757fd1af-c7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:41.530430 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap757fd1af-c7, col_values=(('qos', UUID('d3496294-a9de-4e53-942a-3090eb71ecd7')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:41.530707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap757fd1af-c7, col_values=(('external_ids', {'iface-id': '757fd1af-c79d-456e-b641-1382ec7a0b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:93:bf', 'vm-uuid': '0c96a877-c722-4f5d-b621-6d2993d7ad69'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:41.531630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.533219 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:41.540582 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:41.541773 np0000003683 nova-compute[98991]: INFO os_vif [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7')
Jun 26 02:40:41.711058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:41.711562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:41.711562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:41.711708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:41.711750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:41.717193 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Terminating instance
Jun 26 02:40:42.224651 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:40:42.260376 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.264262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.288224 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.292022 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.327197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.327752 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.427094 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:42.579249 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999126235000176 future=<Future at 0x72e29c315160 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:40:42.580944 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998388414000146 future=<Future at 0x72e29c315160 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:40:42.582395 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99588278400006 future=<Future at 0x72e29c315160 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:40:42.586177 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Instance destroyed successfully.
Jun 26 02:40:42.586408 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lazy-loading 'resources' on Instance uuid 78756f9d-416d-4bb5-a50b-f7401d3789c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:43.005645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.061901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:43.062511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:40:43.062661 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No VIF found with MAC fa:16:3e:ef:93:bf, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:40:43.063226 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Using config drive
Jun 26 02:40:43.091749 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-678791422',display_name='tempest-DeleteServersTestJSON-server-678791422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-deleteserverstestjson-server-678791422',id=1,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7249714268a84dc2942c668f4096bb5b',ramdisk_id='',reservation_id='r-70m8ztuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-70351402',owner_user_name='tempest-DeleteServersTestJSON-70351402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:40:28Z,user_data=None,user_id='aa6ac420579348c284a33443abac5250',uuid=78756f9d-416d-4bb5-a50b-f7401d3789c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:40:43.091993 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converting VIF {"id": "55c855da-4062-4f73-8b16-5c7716de5da5", "address": "fa:16:3e:20:6b:08", "network": {"id": "a99c29d6-854f-457b-9ee8-d21ce4c1932a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-579622851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7249714268a84dc2942c668f4096bb5b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c855da-40", "ovs_interfaceid": "55c855da-4062-4f73-8b16-5c7716de5da5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:43.092740 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:43.093059 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:40:43.097082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.097399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55c855da-40, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:43.101433 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.101433 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:43.108374 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.108895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.109923 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=070aa6a4-c1ba-40fb-b862-639fbcac5491) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:43.110834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:43.116524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:43.118591 np0000003683 nova-compute[98991]: INFO os_vif [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:08,bridge_name='br-int',has_traffic_filtering=True,id=55c855da-4062-4f73-8b16-5c7716de5da5,network=Network(a99c29d6-854f-457b-9ee8-d21ce4c1932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c855da-40')
Jun 26 02:40:43.122754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:40:43.123161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:40:43.123338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:40:43.123788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:40:43.124261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7276208e-6e85-482c-9b82-502ded1432fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:40:43.124553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:40:43.155970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:43.155970 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:43.155970 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:43.155970 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:43.155970 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:40:43.156230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:43.156230 np0000003683 nova-compute[98991]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd (non-flash)
Jun 26 02:40:43.156230 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:43.156230 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:40:43.156230 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:40:43.156559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:40:43.156559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', '4')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:40:43.158089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd', '3')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:40:43.161625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4d2480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:40:43.162154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:40:43.162642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Flush multipath device 3300000007cfcb9b7 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:40:43.192487 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:40:43.246412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:40:43.296461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:40:43.296461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:40:43.298200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:40:43.314786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:40:43.315338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:40:43.326525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.355921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.40.100,3260]
Jun 26 02:40:43.355921 np0000003683 nova-compute[98991]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.40.100,3260] successful.
Jun 26 02:40:43.355921 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.371372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.383225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.418788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.50.100,3260]
Jun 26 02:40:43.418788 np0000003683 nova-compute[98991]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-7276208e-6e85-482c-9b82-502ded1432fd, portal: 192.168.50.100,3260] successful.
Jun 26 02:40:43.418788 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.430300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:40:43.430608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:40:43.430785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] <== disconnect_volume: return (307ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:40:43.434179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:40:43.434514 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Deleting instance files /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2_del
Jun 26 02:40:43.435312 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Deletion of /opt/stack/data/nova/instances/78756f9d-416d-4bb5-a50b-f7401d3789c2_del complete
Jun 26 02:40:43.569114 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:43.751915 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating config drive at /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config
Jun 26 02:40:43.756271 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7kls1fbq {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:43.787859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7kls1fbq" returned: 0 in 0.031s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:43.942283 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Took 1.72 seconds to destroy the instance on the hypervisor.
Jun 26 02:40:43.945402 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:40:43.945402 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:40:43.945402 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:40:43.945402 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:44.032464 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:44.250608 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.275446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.396389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.502387 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-89bcd666-906f-469b-85d1-a491ecd52b9f req-68ea5776-211d-4990-af02-1cfbc669e601 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Received event network-vif-deleted-55c855da-4062-4f73-8b16-5c7716de5da5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:44.503152 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-89bcd666-906f-469b-85d1-a491ecd52b9f req-68ea5776-211d-4990-af02-1cfbc669e601 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Neutron deleted interface 55c855da-4062-4f73-8b16-5c7716de5da5; detaching it from the instance and deleting it from the info cache
Jun 26 02:40:44.506506 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-89bcd666-906f-469b-85d1-a491ecd52b9f req-68ea5776-211d-4990-af02-1cfbc669e601 service nova] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Detach interface failed, port_id=55c855da-4062-4f73-8b16-5c7716de5da5, reason: Instance 78756f9d-416d-4bb5-a50b-f7401d3789c2 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:40:44.673826 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.679833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.681063 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.696414 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:44.931080 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:45.077008 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441645.0765967, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:45.077507 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Started (Lifecycle Event)
Jun 26 02:40:45.433327 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Took 1.49 seconds to deallocate network for instance.
Jun 26 02:40:45.579872 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:45.582040 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441645.581805, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:45.582205 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Paused (Lifecycle Event)
Jun 26 02:40:45.728450 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:46.027086 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Took 0.59 seconds to detach 1 volumes for instance.
Jun 26 02:40:46.084454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:46.087805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:46.464372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:46.533838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:46.534081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:46.590280 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:46.597986 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.598402 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.599420 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.599420 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.599420 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.599642 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.600004 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.600259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:40:46.600509 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:40:46.897680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:46.898026 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:47.105412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:47.402315 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:47.907931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.374s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:47.909420 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.804s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:47.909673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:47.909860 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:40:47.973327 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Deleted allocations for instance 78756f9d-416d-4bb5-a50b-f7401d3789c2
Jun 26 02:40:48.112259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-de88bd77-3c0d-44e9-ad74-69e722f49a8b req-1afa81f1-e1ba-4849-a157-634c60c7ca6d service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:48.112780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-de88bd77-3c0d-44e9-ad74-69e722f49a8b req-1afa81f1-e1ba-4849-a157-634c60c7ca6d service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:48.113386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-de88bd77-3c0d-44e9-ad74-69e722f49a8b req-1afa81f1-e1ba-4849-a157-634c60c7ca6d service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:48.113659 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:48.114606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-de88bd77-3c0d-44e9-ad74-69e722f49a8b req-1afa81f1-e1ba-4849-a157-634c60c7ca6d service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:48.114773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-de88bd77-3c0d-44e9-ad74-69e722f49a8b req-1afa81f1-e1ba-4849-a157-634c60c7ca6d service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Processing event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:40:48.117374 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:40:48.120947 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441648.1204689, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:48.121105 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Resumed (Lifecycle Event)
Jun 26 02:40:48.123017 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:40:48.125351 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance spawned successfully.
Jun 26 02:40:48.125351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:40:48.505301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:48.505524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:48.624671 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:48.625921 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:40:48.630793 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.630944 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.631238 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.631469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.631755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.632018 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:40:48.931510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:40:48.933680 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:48.985638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2aafcc77-27c4-47d0-83e2-28d45de1cb2f tempest-DeleteServersTestJSON-70351402 tempest-DeleteServersTestJSON-70351402-project-member] Lock "78756f9d-416d-4bb5-a50b-f7401d3789c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.274s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:49.007807 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:49.012564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.013128 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.100958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.103632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.130626 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:40:49.137850 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Took 15.42 seconds to spawn the instance on the hypervisor.
Jun 26 02:40:49.138091 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:49.183417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.184266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.256833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.259690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.330294 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.330850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.397955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.400722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.466858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.467600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.535508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.536386 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:49.537070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:49.558575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.021s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:49.559023 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51769MB free_disk=74.54643249511719GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:40:49.559185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:49.559421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:49.601160 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:49.648203 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Took 27.48 seconds to build instance.
Jun 26 02:40:50.149651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.989s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:40:50.201008 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1c5a73b4-17e1-401b-a4ba-448e72f00f33 req-ca379b1f-2f65-42f7-a75d-4e23f38bf598 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received unexpected event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with vm_state active and task_state None.
Jun 26 02:40:50.309289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-changed-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:50.309675 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Refreshing instance network info cache due to event network-changed-757fd1af-c79d-456e-b641-1382ec7a0b5a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:50.310132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] Acquiring lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:50.310132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] Acquired lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:50.310349 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Refreshing network info cache for port 757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:50.615747 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:40:50.615890 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:40:50.616006 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:40:50.616115 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:40:50.616196 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0c96a877-c722-4f5d-b621-6d2993d7ad69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:40:50.814546 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:51.118860 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 26 02:40:51.118860 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:40:51.119297 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:40:49 up 27 min,  2 users,  load average: 7.92, 3.16, 1.45\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_fc72b1dff20e43d1b244280499fc5f65': '1', 'io_workload': '0', 'num_proj_f3004e12281740988b4f5119899f222b': '1', 'num_proj_5eaae08be6c14d52b705eb1c0bb160bf': '1', 'num_proj_fe57b3cf078f49879b9e2b586be5a31b': '1', 'num_proj_604c96beaf0646b38621c7b79c2968bd': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:40:51.180534 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:51.348516 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updated VIF entry in instance network info cache for port 757fd1af-c79d-456e-b641-1382ec7a0b5a. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:40:51.348516 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating instance_info_cache with network_info: [{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:51.466006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:51.494764 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:51.495017 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:51.850565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-981f331b-bd89-453d-9ed0-57fffd3d431b req-f107f08d-6378-4991-8a22-fcd3dbc3a69c service nova] Releasing lock "refresh_cache-0c96a877-c722-4f5d-b621-6d2993d7ad69" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:51.997921 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:52.506464 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:40:52.507032 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.947s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:52.507453 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 57.74 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:40:52.508588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.908s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:52.517963 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:52.518136 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Claim successful on node np0000003683
Jun 26 02:40:52.556306 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:52.596614 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:53.114981 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:53.895312 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:40:53.895719 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:40:54.398721 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:40:54.907450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.399s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:54.908017 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:40:55.414746 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:40:55.414949 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:40:55.415258 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:55.415493 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:55.512379 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bb1094ab9904a39a5c111c76c89104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d8ccf228940a5af4ec7724cc6700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:40:55.914863 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:40:56.064785 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Successfully created port: 0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:40:56.417960 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:40:56.467989 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:56.625411 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Successfully updated port: 0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:40:56.677571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-changed-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:40:56.677973 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing instance network info cache due to event network-changed-0bd9217b-5ac1-4a72-b992-ba42ce27ad04. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:40:56.677973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:56.678120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:56.678120 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing network info cache for port 0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:40:57.128282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:40:57.180415 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:57.271845 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:57.426271 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:40:57.427296 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:40:57.427706 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Creating image(s)
Jun 26 02:40:57.428950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:57.429622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:57.429793 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:57.430338 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:57.433220 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:57.434461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:57.470022 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:57.518238 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:57.518792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:57.519574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:57.520205 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:57.524700 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:40:57.525340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:57.579710 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00135492799995518 future=<Future at 0x72e29c315160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:40:57.580236 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782441642.5781214, 78756f9d-416d-4bb5-a50b-f7401d3789c2 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:40:57.580493 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:40:57.580616 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] VM Stopped (Lifecycle Event)
Jun 26 02:40:57.592586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:57.593033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:57.625143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk 1073741824" returned: 0 in 0.032s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:57.625966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.106s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:57.626421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:57.696721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:57.697934 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:40:57.698339 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:40:57.769052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:40:57.769758 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Cannot resize image /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:40:57.770325 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:40:57.770668 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Ensure instance console log exists: /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:40:57.771085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:57.771374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:57.771630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:57.973341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1412b11e-2672-4938-9d17-e7526be5f331 req-79872687-f2df-4456-9f11-a2dd6fee04d9 service nova] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:57.973946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:40:57.974336 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:40:58.084530 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-819c0b29-492e-4607-9d65-1c72face958a None None] [instance: 78756f9d-416d-4bb5-a50b-f7401d3789c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:40:58.117096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:58.233688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:58.234182 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:58.544024 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:40:58.688099 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:40:58.736588 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:40:58.851825 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:40:59.324627 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:59.324627 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:59.326177 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:40:59.326448 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Claim successful on node np0000003683
Jun 26 02:40:59.354364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:40:59.354708 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance network_info: |[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:40:59.356563 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Start _get_guest_xml network_info=[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:40:59.358391 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:40:59.360164 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-102461132', uuid='9bc60ab4-5d7c-4f30-876b-9b9451b446f2'), owner=OwnerMeta(userid='9bb1094ab9904a39a5c111c76c89104a', username='tempest-TaggedAttachmentsTest-1104328228-project-member', projectid='e41d8ccf228940a5af4ec7724cc6700b', projectname='tempest-TaggedAttachmentsTest-1104328228'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441659.3594472) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:40:59.361364 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:40:59.361847 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:40:59.363377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:40:59.363863 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:40:59.365384 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:40:59.365866 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:40:59.366026 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:40:59.367164 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:40:59.367379 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:40:59.367517 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:40:59.367686 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:40:59.367923 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:40:59.368073 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:40:59.368271 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:40:59.368411 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:40:59.368609 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:40:59.388092 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:40:59.388261 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:59.388992 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:59.389708 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <uuid>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</uuid>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <name>instance-00000007</name>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:40:59</nova:creationTime>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="serial">9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="uuid">9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:15:2a:85"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <target dev="tap0bd9217b-5a"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log" append="off"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:40:59.892612 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:40:59.895956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Preparing to wait for external event network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:40:59.895956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:40:59.895956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:40:59.895956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:40:59.895956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:40:59.896141 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:40:59.896141 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:40:59.896220 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:40:59.896800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.897049 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:59.897331 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:40:59.898081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.898270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2ab5fc8-54f7-5fa1-89c3-931563273435', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:59.899105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.900093 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:59.901459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.903815 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.903928 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bd9217b-5a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:59.904220 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bd9217b-5a, col_values=(('qos', UUID('e972cc78-dab2-4b5e-9863-c25f81d0ed30')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:59.904385 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bd9217b-5a, col_values=(('external_ids', {'iface-id': '0bd9217b-5ac1-4a72-b992-ba42ce27ad04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:2a:85', 'vm-uuid': '9bc60ab4-5d7c-4f30-876b-9b9451b446f2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:40:59.905200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.906818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:40:59.912276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:40:59.913269 np0000003683 nova-compute[98991]: INFO os_vif [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a')
Jun 26 02:41:00.732425 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:00.733058 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:01.235456 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:01.429412 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:01.429623 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:01.429697 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No VIF found with MAC fa:16:3e:15:2a:85, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:01.430136 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Using config drive
Jun 26 02:41:01.469142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:01.741859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.418s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:01.742299 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:41:01.935282 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:02.073430 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Creating config drive at /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config
Jun 26 02:41:02.077158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvfhzwpg3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:02.110876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvfhzwpg3" returned: 0 in 0.033s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:02.249729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:41:02.253219 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:41:02.253219 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:02.253219 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:02.462218 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ca66b021300400abc47122d1ff3006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07b56acd3834878b91328ea5bf2fb99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:41:02.543876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.574832 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.579415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.662845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.737730 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a9c55e18-57a8-40e3-8be6-502123a206a8 req-1607c12d-742b-43ad-a8c6-90e49f810fc8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:02.737730 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a9c55e18-57a8-40e3-8be6-502123a206a8 req-1607c12d-742b-43ad-a8c6-90e49f810fc8 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:02.739466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a9c55e18-57a8-40e3-8be6-502123a206a8 req-1607c12d-742b-43ad-a8c6-90e49f810fc8 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:02.739630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a9c55e18-57a8-40e3-8be6-502123a206a8 req-1607c12d-742b-43ad-a8c6-90e49f810fc8 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:02.739832 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a9c55e18-57a8-40e3-8be6-502123a206a8 req-1607c12d-742b-43ad-a8c6-90e49f810fc8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Processing event network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:02.754465 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:41:02.913911 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.915155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.919356 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.935095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.937104 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:02.975006 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully created port: dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:03.352426 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully created port: c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:03.400082 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441663.3996708, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:03.400198 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] VM Started (Lifecycle Event)
Jun 26 02:41:03.401593 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:03.403806 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:41:03.406675 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance spawned successfully.
Jun 26 02:41:03.407297 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:41:03.769025 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully created port: 3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:03.902597 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:03.903678 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:03.914618 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:03.914766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:03.915145 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:03.915365 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:03.915665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:03.915942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:04.132582 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully created port: 1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:04.271138 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:41:04.406961 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:41:04.407346 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441664.407157, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:04.407458 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] VM Paused (Lifecycle Event)
Jun 26 02:41:04.420075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Took 6.99 seconds to spawn the instance on the hypervisor.
Jun 26 02:41:04.420525 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:04.577142 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully created port: d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:04.776316 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Booting with volume a899dbfa-c6ee-425d-97f1-1d232bf907f4 at /dev/vda
Jun 26 02:41:04.797780 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:04.799041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:04.799213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:04.799359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:04.805827 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:04.807244 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-18daab54-11d3-4bdc-b09a-4dc80a1d816e req-34fc49f9-09c9-4ff2-a97c-64bca1a60bd7 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received unexpected event network-vif-plugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 for instance with vm_state active and task_state None.
Jun 26 02:41:04.822366 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:04.834291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:04.855242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:04.880991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:04.880991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:04.888853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:04.890128 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:04.890260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:04.890373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:04.890610 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:04.890823 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating existing volume attachment record: 0b9a6fd5-8312-4701-a477-af3c1fc8fce7 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:04.906165 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:04.910118 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:04.913520 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441664.9131806, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:04.913699 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] VM Resumed (Lifecycle Event)
Jun 26 02:41:04.935097 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Took 15.42 seconds to build instance.
Jun 26 02:41:05.106042 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:05.147839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:05.147989 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-dc1162a0-6944-4512-8fe0-85b1f5b087db. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:05.148231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:05.148377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:05.148560 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:05.418219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:05.419471 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:05.436639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.931s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:05.466863 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-changed-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:05.467330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing instance network info cache due to event network-changed-0bd9217b-5ac1-4a72-b992-ba42ce27ad04. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:05.467541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:05.467678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:05.467852 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing network info cache for port 0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:05.651378 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:05.741925 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:05.900619 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:05.938156 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:05.938577 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:05.970987 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:06.144714 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: 17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:06.297971 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:06.402361 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a896682-c282-4806-8bb8-291ffe71e114 req-820f5e27-726e-4d0f-bb0f-95e1d811e889 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:06.441411 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'flavor' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:06.444082 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updated VIF entry in instance network info cache for port 0bd9217b-5ac1-4a72-b992-ba42ce27ad04. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:41:06.444453 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:06.472180 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:06.520564 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Booting with volume 710d7309-2205-437a-9456-e6d07c808eb1 at /dev/vdb
Jun 26 02:41:06.563638 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:06.575214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:06.596522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:06.620860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:06.622166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:06.632352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:06.635918 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:06.636296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:06.636604 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:06.637065 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:06.637534 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating existing volume attachment record: 89809232-82f6-4090-848f-4f9430b98852 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:06.950061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-df9a7f9e-cd04-489b-b168-cf60a352109e req-1a2a90b9-f2d5-4e88-bb88-6afa5d1d21c6 service nova] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:07.240147 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:07.240750 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-17dc09be-78c3-4d85-b3c7-945d44f5b867. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:07.240989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:07.241092 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:07.241219 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port 17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:07.278734 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: 0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:07.451368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:07.744197 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:07.832949 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:08.012582 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:08.277748 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Booting with volume ed870baa-71ab-41d1-ae86-daa9f4a46c61 at /dev/vdc
Jun 26 02:41:08.324609 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:08.335063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:08.355349 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:08.357542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:08.379582 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:08.380192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:08.388534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:08.389903 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:08.390080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:08.390226 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:08.390559 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:08.390848 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating existing volume attachment record: dfeb6de4-e28d-4678-8eb2-89cf75257419 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:08.514939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6973d9a0-e144-4ee0-b4c3-9a8bdb100327 req-ad055374-d784-4586-a113-e54a38572dad service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:08.950552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:08.950737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:08.950948 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attaching volume 7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc to /dev/vdb
Jun 26 02:41:08.994130 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:09.004425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:09.023108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:09.045668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:09.045907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:09.054565 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:09.056273 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:09.056424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:09.056662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:09.056968 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:09.057347 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating existing volume attachment record: f372fc70-64ce-4dd2-a8a4-dda4091d9eea {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:09.187835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:09.187835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:09.310603 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:09.310785 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-0526e7f8-4e62-422b-b315-7fb06a018af2. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:09.310920 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:09.311016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:09.311120 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port 0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:09.450653 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: 3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:09.607373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:09.607695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:09.607839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:09.608344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:09.608575 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:09.619197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:09.619882 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:09.620348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:09.620569 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:09.621330 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:09.621546 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:09.631321 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:09.631321 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:09.635607 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:09.635607 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:09.642117 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:09.642382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:09.642437 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:09.642605 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:09.645843 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:09.646170 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:09.646218 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:09.646393 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:09.689602 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:41:09.816158 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:09.873130 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:09.909787 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:10.004890 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:10.258592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:10.258986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:10.262394 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:41:10.262617 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Claim successful on node np0000003683
Jun 26 02:41:10.433290 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: 1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:10.492500 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:10.492699 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-1932230d-5ed0-46f3-960f-26380b626a2d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:10.492896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:10.496998 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:41:10.498059 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:41:10.498285 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Creating image(s)
Jun 26 02:41:10.498557 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:41:10.498694 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Ensure instance console log exists: /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:41:10.498916 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:10.499061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:10.499175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:10.507573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:10.507804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:10.507995 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-c318b8cc-5e75-4e4e-bde6-e66a088b5f53. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:10.508167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:10.508304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:10.508456 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:10.642993 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:10.646801 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:10.653606 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:10.658971 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.666095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.673946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.678493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.678493 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.678493 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:10.678691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.678691 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.678691 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:10.686159 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.686159 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.686159 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:10.686388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.686388 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.686388 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:10.705981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:41:10.705981 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:10.705981 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.712520 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:41:10.712520 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:10.712520 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.716953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.723657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('7', '-', '-', 0) found on session 7 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:10.732506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:10.738428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.738428 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.738428 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.738428 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.738428 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:10.738699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.738699 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:10.738699 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.738699 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:10.738699 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:10.738996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:10.739097 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:10.739846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('8', '-', '-', 0) found on session 8 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:10.739948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:10.746294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 7 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:10.753217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 8 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:10.753489 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:10.983188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:10.983335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:11.010565 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:11.076063 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:11.226067 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:11.380638 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:11.381041 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-3c992a23-0d9c-4427-b13f-710d10309ee8. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:11.381155 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:11.409394 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Successfully updated port: d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:11.474081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:11.486407 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lazy-loading 'flavor' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:11.648955 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:11.649280 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:11.728609 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b208a7dc-dc04-4300-a851-51c359949b19 req-463b6f12-bdc8-4df5-9b85-97001aefcf20 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:11.729008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:11.729171 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port 1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:11.745569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 7 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:11.745706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:11.914131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:12.151950 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:12.231392 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:12.295995 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:12.423863 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:12.491020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:12.548248 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:12.548793 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-d34d2d35-a59e-42f8-8971-71b744a18144. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:12.549061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:12.641215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Found WWN 330000000b9eb3d9f for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:12.641501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:12.641501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-0', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:12.641501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-0', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:12.643088 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'flavor' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:12.658444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.400s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:12.658843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:41:12.925683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f5334b2f-7f1f-4414-99b6-d1fc1a621266 req-95aa0365-6f03-467c-8d78-6922b9004fe2 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:12.926137 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:12.926345 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port 3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:13.145976 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attempting to attach volume 7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:   <alias name="ua-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc"/>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:   <serial>7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc</serial>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:13.146862 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:41:13.163703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:41:13.164366 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:41:13.166675 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:13.166675 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:13.252170 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc748533ff1b49ecbfc2f8e239350cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3004e12281740988b4f5119899f222b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:41:13.428906 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:13.514403 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:13.664499 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:41:13.706838 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:13.788976 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Successfully created port: 447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:13.984970 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:13.985159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:13.985447 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Attaching volume 02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b to /dev/vdb
Jun 26 02:41:14.035648 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:14.047460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:14.069558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:14.092607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:14.092887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:14.101364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:14.103352 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:14.103501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:14.103573 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:14.103793 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:14.104082 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updating existing volume attachment record: 2f3e9d44-07a3-4e23-92cf-d29daedcc38a {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:14.169244 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:41:14.210193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80c68d39-8450-4e0b-b890-29096235782e req-6782f568-cd8a-4054-be5f-c1fe01991180 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:14.210709 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:14.210894 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:14.356043 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Successfully updated port: 447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:14.398938 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-changed-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:14.399066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Refreshing instance network info cache due to event network-changed-447a0c0e-b79d-4be4-9e70-b22de519bb71. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:14.399235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] Acquiring lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:14.399331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] Acquired lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:14.399418 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Refreshing network info cache for port 447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:14.700241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:14.700610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:14.700694 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:14.701116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:14.701403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:14.712908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:14.713326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:14.713704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:14.713915 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:14.714215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:14.714357 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:14.727031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:14.727031 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:14.728328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:14.728328 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b] added
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:14.737708 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:14.738014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:14.738014 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:14.738165 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b] added
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:14.741631 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:14.741951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:14.742023 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:14.742261 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:14.794154 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:14.816457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:14.816657 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:14.816848 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:14.817006 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No VIF found with MAC fa:16:3e:45:8c:a8, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:14.857906 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:14.901064 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:14.912002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:14.954441 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:14.988370 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:15.133822 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:15.177130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:41:15.178533 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:41:15.178804 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating image(s)
Jun 26 02:41:15.179905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:15.180123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:15.180903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:15.181575 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:15.195746 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:15.200190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:15.284453 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:15.284875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:15.285369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:15.285940 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:15.289450 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:15.289450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:15.359700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:15.360135 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:15.401033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk 1073741824" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:15.401493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:15.401840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:15.470369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.068s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:15.470999 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:41:15.471365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:15.549855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:15.550323 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Cannot resize image /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:41:15.550831 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:41:15.551073 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Ensure instance console log exists: /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:41:15.551442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:15.551862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:15.552063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:15.635842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11179085-54ba-4bff-b2d2-bf05918a67a5 req-d789a8d9-ef9f-4772-863a-ff3d31866857 service nova] Releasing lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:15.636232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:15.636410 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:15.738704 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:15.742698 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:15.753817 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.759334 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:15.763061 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.770025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.776100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.787854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.787854 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.787854 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.787854 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.787854 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:15.788036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.788036 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.788036 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.788036 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.788036 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:15.792564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.792564 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.792564 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.792564 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.792564 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:15.792661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.792661 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.792661 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.792661 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.792661 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:15.824308 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.50.100,3260]
Jun 26 02:41:15.824308 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:15.824308 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.835992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.842256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.40.100,3260]
Jun 26 02:41:15.842256 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:15.842256 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.850096 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.850412 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:15.850691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:15.850888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:15.855792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:15.856071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:15.856544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:15.870786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:15.870786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.875691 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:15.875953 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:15.876153 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:15.876275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:15.876970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:15.877090 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:15.891492 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:15.891683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:16.095435 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:16.207983 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:16.384190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d32ce1ac-a3f5-4b97-9f2c-d9d4482e396e tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:16.392788 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:16.396466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:16.398207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:16.408602 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:16.478650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:16.594989 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating instance_info_cache with network_info: [{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:16.714559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:16.782503 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:16.903705 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lazy-loading 'flavor' on Instance uuid 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:17.097414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:17.097414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance network_info: |[{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:41:17.099092 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start _get_guest_xml network_info=[{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:17.101623 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:17.104253 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-578817223', uuid='254192ed-bf2e-4f50-8c84-3be4648db8b3'), owner=OwnerMeta(userid='bc748533ff1b49ecbfc2f8e239350cea', username='tempest-ServerActionsTestOtherA-1295549616-project-member', projectid='f3004e12281740988b4f5119899f222b', projectname='tempest-ServerActionsTestOtherA-1295549616'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441677.1034973) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:17.105352 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:17.106056 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:17.108372 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:17.109972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:17.110532 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:17.111761 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:17.112294 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:17.112607 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:17.112830 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:17.113046 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:17.113217 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:17.113372 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:17.113630 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:17.113883 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:17.114073 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:17.114305 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:17.114578 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:17.126640 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-tempest.common.compute-instance-578817223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:17.126640 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:17.127696 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:17.128701 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'pci_devices' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:17.390560 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:17.523952 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <uuid>254192ed-bf2e-4f50-8c84-3be4648db8b3</uuid>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <name>instance-00000009</name>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:name>tempest-tempest.common.compute-instance-578817223</nova:name>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:17</nova:creationTime>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:user uuid="bc748533ff1b49ecbfc2f8e239350cea">tempest-ServerActionsTestOtherA-1295549616-project-member</nova:user>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:project uuid="f3004e12281740988b4f5119899f222b">tempest-ServerActionsTestOtherA-1295549616</nova:project>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         <nova:port uuid="447a0c0e-b79d-4be4-9e70-b22de519bb71">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="serial">254192ed-bf2e-4f50-8c84-3be4648db8b3</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="uuid">254192ed-bf2e-4f50-8c84-3be4648db8b3</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c0:70:ce"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <target dev="tap447a0c0e-b7"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/console.log" append="off"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Preparing to wait for external event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-tempest.common.compute-instance-578817223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:17.633470 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:17.636302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.636302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:17.636302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:17.637570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.637788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0fc7490-2a0e-594c-b178-2b77a6994a06', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:17.638550 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.639192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:17.640978 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.642761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.642924 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap447a0c0e-b7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:17.643223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap447a0c0e-b7, col_values=(('qos', UUID('898339b0-2759-4e34-a286-8de9b3523688')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:17.643378 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap447a0c0e-b7, col_values=(('external_ids', {'iface-id': '447a0c0e-b79d-4be4-9e70-b22de519bb71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:70:ce', 'vm-uuid': '254192ed-bf2e-4f50-8c84-3be4648db8b3'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:17.644033 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.645131 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:17.650750 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:17.651843 np0000003683 nova-compute[98991]: INFO os_vif [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7')
Jun 26 02:41:17.734660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Found WWN 3300000007dc5719f for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:17.735337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:17.735337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000007dc5719f', 'path': '/dev/dm-4', 'multipath_id': '3300000007dc5719f'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:17.735337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007dc5719f', 'path': '/dev/dm-4', 'multipath_id': '3300000007dc5719f'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:17.739522 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lazy-loading 'flavor' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:17.907783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:18.026043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:18.026453 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance network_info: |[{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:41:18.026938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:18.028191 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Start _get_guest_xml network_info=[{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b9a6fd5-8312-4701-a477-af3c1fc8fce7', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3634e3e6-38af-4398-aaa3-e4cda9ac642e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'serial': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '89809232-82f6-4090-848f-4f9430b98852', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3634e3e6-38af-4398-aaa3-e4cda9ac642e', 'attached_at': '', 'detached_at': '', 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'serial': '710d7309-2205-437a-9456-e6d07c808eb1'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'volume_type': None}, {'attachment_id': 'dfeb6de4-e28d-4678-8eb2-89cf75257419', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3634e3e6-38af-4398-aaa3-e4cda9ac642e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'serial': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:18.028437 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:18.030012 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:18.031063 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-389598634', uuid='3634e3e6-38af-4398-aaa3-e4cda9ac642e'), owner=OwnerMeta(userid='5ca66b021300400abc47122d1ff3006b', username='tempest-TaggedBootDevicesTest-1043317399-project-member', projectid='a07b56acd3834878b91328ea5bf2fb99', projectname='tempest-TaggedBootDevicesTest-1043317399'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441678.0306685) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:18.032234 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:18.032234 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:18.032870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:18.033420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:18.033819 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:18.034213 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:18.034387 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:18.034509 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:18.034688 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:18.034807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:18.034919 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:18.035073 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:18.035189 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:18.035307 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:18.035423 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:18.035582 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:18.045638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:18.045956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:18.046074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:18.046391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:18.046610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:18.056552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:18.057103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:18.057528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:18.057869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:18.058073 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:18.058303 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:18.068702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:18.068702 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:18.078431 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:18.078431 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4] added
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:18.087940 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:18.088205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:18.088420 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:18.088596 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4] added
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:18.091398 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:18.091653 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:18.091766 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:18.091931 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:18.243596 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Attempting to attach volume 02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] attach device xml: <disk type="block" device="disk">
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:   <alias name="ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b"/>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:   <serial>02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b</serial>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:18.245510 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:41:18.532501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:18.858602 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:19.023422 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updated VIF entry in instance network info cache for port d34d2d35-a59e-42f8-8971-71b744a18144. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:41:19.024080 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:19.089096 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:19.092372 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:19.102231 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:19.109058 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.115072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.122245 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.132036 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.132331 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.143004 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.143461 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:19.175619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.40.100,3260]
Jun 26 02:41:19.175619 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:19.175619 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.176610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:19.176757 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:19.176888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:c0:70:ce, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:19.177430 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Using config drive
Jun 26 02:41:19.187988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.50.100,3260]
Jun 26 02:41:19.187988 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:19.187988 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.191532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.201911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:19.210608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:19.211763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:19.211956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:19.222220 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:19.223184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:19.223287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:19.229058 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Stashing vm_state: active {{(pid=98991) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 26 02:41:19.233167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:19.233167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:19.233862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:19.233990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:19.253727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:19.253727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:19.444500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:19.444500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:19.444500 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Attaching volume d2343b0f-6823-48fb-9a33-c53eb2f50497 to /dev/sdc
Jun 26 02:41:19.514810 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:19.525984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:19.531316 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f19e646-2aa0-4910-a75a-7f9da920a8dd req-b52630f4-2e10-4a57-9d04-935468cf943a service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:19.550562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:19.567891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:19.568316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:19.576788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:19.578708 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe45:8ca8', 'fe80::fc16:3eff:febf:32cc', 'fe80::d3:ccff:fe19:38df', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:6918', 'fe80::7c30:b7ff:fe83:e35c', 'fe80::fc16:3eff:fe6c:57cd', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b'] 
Jun 26 02:41:19.579007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:19.579203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:19.579557 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:19.579984 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updating existing volume attachment record: 7563442c-e763-47b8-9125-da95a4e0d2fa {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:19.683290 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:19.791373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:19.791373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:19.820633 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating config drive at /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config
Jun 26 02:41:19.824403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr1pfe70m {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:19.856274 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr1pfe70m" returned: 0 in 0.031s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:19.890626 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:19.890774 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:19.890895 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:19.891013 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] No VIF found with MAC fa:16:3e:22:69:18, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:20.058636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:20.137860 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:20.137860 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:20.137860 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:20.307179 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:41:20.307179 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Claim successful on node np0000003683
Jun 26 02:41:20.313081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.333969 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.334638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.422789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.492044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.492948 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:20.585013 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-115b251a-e61e-4c12-8cc6-2dd4ec4748bd req-c30ec6bc-01ba-47ad-854d-1dc8205b49ac service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:20.585318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-115b251a-e61e-4c12-8cc6-2dd4ec4748bd req-c30ec6bc-01ba-47ad-854d-1dc8205b49ac service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:20.585566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-115b251a-e61e-4c12-8cc6-2dd4ec4748bd req-c30ec6bc-01ba-47ad-854d-1dc8205b49ac service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:20.586402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-115b251a-e61e-4c12-8cc6-2dd4ec4748bd req-c30ec6bc-01ba-47ad-854d-1dc8205b49ac service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:20.586564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-115b251a-e61e-4c12-8cc6-2dd4ec4748bd req-c30ec6bc-01ba-47ad-854d-1dc8205b49ac service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Processing event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:20.814034 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating resource usage from migration 47177ad8-834c-43b6-bb58-9edefb6e4c82
Jun 26 02:41:21.076119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Found WWN 33000000014028578 for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:21.076700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:21.076700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000014028578', 'path': '/dev/dm-5', 'multipath_id': '33000000014028578'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:21.076825 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014028578', 'path': '/dev/dm-5', 'multipath_id': '33000000014028578'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:21.077286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.940s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:21.077561 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:21.090517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:21.091137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:21.091815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:21.092086 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:21.092953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:21.093311 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:21.104136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:21.104136 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:21.109949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:21.109949 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497] added
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:21.118125 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:21.118361 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:21.118926 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:21.118926 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497] added
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:21.121323 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:21.121498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:21.121640 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:21.121811 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:21.208276 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:21.208802 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441681.208418, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:21.208957 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Started (Lifecycle Event)
Jun 26 02:41:21.215375 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:41:21.217204 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance spawned successfully.
Jun 26 02:41:21.217533 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:41:21.258069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:21.258283 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:21.443854 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6915df43-6166-48e6-b834-96fc88dfbea0 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.458s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:21.479196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:21.581573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:21.581971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:21.582146 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:21.631172 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] volume_snapshot_create: create_info: {'snapshot_id': '900f1444-260f-4749-a95f-00c4ccacfd84', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98991) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}}
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] snap xml: <domainsnapshot>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:   <disks>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:     <disk name="/dev/dm-4" snapshot="external" type="file">
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:       <source file="/dev/new_file"/>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:     <disk name="vda" snapshot="no"/>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:     <disk name="hda" snapshot="no"/>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:   </disks>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]: </domainsnapshot>
Jun 26 02:41:21.638755 np0000003683 nova-compute[98991]:  {{(pid=98991) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}}
Jun 26 02:41:21.639256 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] Lazy-loading 'system_metadata' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:21.691334 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beb04880-16b8-4d3c-9c14-92463e9935aa tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] volume_snapshot_delete: delete_info: {'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'} {{(pid=98991) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}}
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [None req-beb04880-16b8-4d3c-9c14-92463e9935aa tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Traceback (most recent call last):
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     self._volume_snapshot_delete(context, instance, volume_id,
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     if delete_info['type'] != 'qcow2':
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]        ~~~~~~~~~~~^^^^^^^^
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] KeyError: 'type'
Jun 26 02:41:21.700079 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] 
Jun 26 02:41:21.712277 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:21.718565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:21.723721 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.724282 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.724364 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.724907 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.726007 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.726007 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [None req-beb04880-16b8-4d3c-9c14-92463e9935aa tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-28a95c2f-b19e-4a38-aee2-a12e1418a05e)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Jun 26 02:41:21.748612 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server [None req-beb04880-16b8-4d3c-9c14-92463e9935aa tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] Exception during message handling: KeyError: 'type'
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Jun 26 02:41:21.757581 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server 
Jun 26 02:41:21.760977 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:22.119228 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:22.122207 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:22.131584 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:22.136578 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.142847 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 26 02:41:22.143845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.147685 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Traceback (most recent call last):
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.152445 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] 
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Traceback (most recent call last):
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     self._volume_snapshot_create(context, instance, guest,
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.153353 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] 
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.161974 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.162283 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.172177 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 900f1444-260f-4749-a95f-00c4ccacfd84 could not be found.
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 900f1444-260f-4749-a95f-00c4ccacfd84 could not be found. (HTTP 404) (Request-ID: req-436e6e52-bd98-4170-adeb-826b8814cfa8)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 900f1444-260f-4749-a95f-00c4ccacfd84 could not be found.
Jun 26 02:41:22.194542 np0000003683 nova-compute[98991]: ERROR nova.virt.libvirt.driver 
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server [None req-56a18493-8106-4664-b67b-048dbe7bd6e8 tempest-VolumesAssistedSnapshotsTest-475542480 tempest-VolumesAssistedSnapshotsTest-475542480-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 26 02:41:22.198778 np0000003683 nova-compute[98991]: ERROR oslo_messaging.rpc.server 
Jun 26 02:41:22.201787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.40.100,3260]
Jun 26 02:41:22.201787 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:22.201787 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.213945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.50.100,3260]
Jun 26 02:41:22.213945 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:22.213945 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.214704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.220168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:41:22.220364 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441682.2202163, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:22.220469 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Paused (Lifecycle Event)
Jun 26 02:41:22.226132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:22.232180 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Took 7.05 seconds to spawn the instance on the hypervisor.
Jun 26 02:41:22.232712 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.233353 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.233786 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:22.234080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:22.234252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:22.240285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:22.240465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.245208 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:22.245616 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:22.245942 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:22.245942 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:22.246989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:22.247130 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:22.255600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:22.256122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:22.262135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:22.262135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:22.268037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.476s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:22.268037 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Migrating
Jun 26 02:41:22.268037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:22.268253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:22.410267 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:22.410404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:22.641033 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:22.642374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:22.642611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:22.642809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:22.643090 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:22.643247 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-84916ca7-ab56-4af2-9407-152905fe4fb7 req-5a5f6660-ed3a-4e44-90e0-c60431aceca3 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received unexpected event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with vm_state active and task_state None.
Jun 26 02:41:22.645339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:22.722865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:22.724080 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441682.7238343, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:22.724237 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Resumed (Lifecycle Event)
Jun 26 02:41:22.742831 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Took 12.55 seconds to build instance.
Jun 26 02:41:22.770591 np0000003683 nova-compute[98991]: INFO nova.compute.rpcapi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
Jun 26 02:41:22.771111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:22.771318 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:41:22.913017 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Detaching volume 02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b
Jun 26 02:41:22.966751 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Attempting to driver detach volume 02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b from mountpoint /dev/vdb
Jun 26 02:41:22.973636 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Found disk vdb by alias ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:41:22.974974 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Found disk vdb by alias ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:41:22.975203 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Attempting to detach device vdb from instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] detach device xml: <disk type="block" device="disk">
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <alias name="ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b"/>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <serial>02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b</serial>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:22.975488 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:41:22.982827 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Successfully detached device vdb from instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 from the persistent domain config.
Jun 26 02:41:22.983284 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] (1/8): Attempting to detach device vdb with device alias ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b from instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] detach device xml: <disk type="block" device="disk">
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <alias name="ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b"/>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <serial>02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b</serial>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:22.983499 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:41:23.092839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:23.226492 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:23.227769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:23.244270 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d978ec5-ca0d-4261-bed0-6208cb3ae15b tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.058s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:23.286148 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:23.286297 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:23.286807 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:23.477942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b for instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:41:23.694807 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-changed-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:23.695129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Refreshing instance network info cache due to event network-changed-447a0c0e-b79d-4be4-9e70-b22de519bb71. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:23.695129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] Acquiring lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:23.695245 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] Acquired lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:23.695314 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Refreshing network info cache for port 447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:23.730586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441683.729747, 3e48fc5a-edf8-4497-8815-3430ef4d4391 => ua-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:41:23.733061 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Successfully detached device vdb from instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 from the live domain config.
Jun 26 02:41:23.733812 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:23.734071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:23.734296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:23.789110 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:24.090298 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:24.113018 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Found WWN 330000000d82c0abd for multipath device dm-8 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:24.113249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:24.113375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] <== connect_volume: return (3975ms) {'type': 'block', 'scsi_wwn': '330000000d82c0abd', 'path': '/dev/dm-8', 'multipath_id': '330000000d82c0abd'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:24.113493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d82c0abd', 'path': '/dev/dm-8', 'multipath_id': '330000000d82c0abd'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:24.114867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.533s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:24.115222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:24.116366 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lazy-loading 'flavor' on Instance uuid 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:24.125866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:24.126396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:24.127266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:24.127427 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:24.128074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:24.128222 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:24.138178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:24.138178 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:24.146828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:24.146828 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1] added
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:24.150432 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:24.150825 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:24.150825 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:24.150972 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1] added
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:24.157893 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:24.158104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:24.158238 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:24.158393 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:24.197881 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:24.238243 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:24.486544 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <alias name="ua-d2343b0f-6823-48fb-9a33-c53eb2f50497"/>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-8"/>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <target dev="sdc" bus="scsi"/>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <serial>d2343b0f-6823-48fb-9a33-c53eb2f50497</serial>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:   <address type="drive" controller="0" unit="2"/>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:24.626289 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:41:24.658084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:24.667207 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updated VIF entry in instance network info cache for port 447a0c0e-b79d-4be4-9e70-b22de519bb71. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:41:24.667545 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating instance_info_cache with network_info: [{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:24.740500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:25.151407 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:25.158924 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:25.163775 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.169568 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7666fe0a-d531-4536-ae96-0efeab973538 req-bad9391a-365a-4c3e-93da-ce3d1fccf182 service nova] Releasing lock "refresh_cache-254192ed-bf2e-4f50-8c84-3be4648db8b3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:25.171278 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.177396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.182358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.192326 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.192785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.199020 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.199302 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:25.240161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.40.100,3260]
Jun 26 02:41:25.240161 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:25.240161 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.254361 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.259447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.50.100,3260]
Jun 26 02:41:25.259447 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:25.259447 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.273403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.279074 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:25.279412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:25.279761 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:25.280673 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:25.280810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:25.296115 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:25.296927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:25.296927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:25.298848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:25.299132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:25.300137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:25.300253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:25.317032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:25.317261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:26.127962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:26.217408 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.260508 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Starting migrate_disk_and_power_off {{(pid=98991) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}}
Jun 26 02:41:26.282327 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.287298 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.309451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.324086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No BDM found with device name sda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:26.324231 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:26.324270 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:26.324337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] No VIF found with MAC fa:16:3e:6c:57:cd, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:26.331671 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.480805 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.552240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.582626 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999583183999903 future=<Future at 0x72e29c2ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:26.584253 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance destroyed successfully.
Jun 26 02:41:26.585224 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:25Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:41:26.585436 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:26.586111 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.995998505999978 future=<Future at 0x72e29c2ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:26.586337 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:26.586591 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.995503404999909 future=<Future at 0x72e29c2ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:26.586779 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:41:26.588452 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.588691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809bd0a4-ea, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:26.590558 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.592707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:26.594223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.594361 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91d248e3-0279-424b-98ee-e268ce6d1e32) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:26.596389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:26.596965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:26.598632 np0000003683 nova-compute[98991]: INFO os_vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:41:26.599694 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:26.600046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:26.600217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:27.144438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Found WWN 3300000004161f2ad for multipath device dm-9 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:27.144807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:27.145036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== connect_volume: return (5563ms) {'type': 'block', 'scsi_wwn': '3300000004161f2ad', 'path': '/dev/dm-9', 'multipath_id': '3300000004161f2ad'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:27.145385 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004161f2ad', 'path': '/dev/dm-9', 'multipath_id': '3300000004161f2ad'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:27.145877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.412s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:27.146345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:27.146534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:27.187666 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b (non-flash)
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:27.188052 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', '9')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:27.188320 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', '10')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:27.190421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b', '9')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:27.190421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c2840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'): ({'sdf'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:27.190693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:41:27.191563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Flush multipath device 3300000007dc5719f {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:41:27.238606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:27.297232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:27.356850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:41:27.357088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:41:27.360855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:41:27.376888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:41:27.377133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:27.391182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.431890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.40.100,3260]
Jun 26 02:41:27.431890 np0000003683 nova-compute[98991]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:27.431890 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.452353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.464124 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.509705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.50.100,3260]
Jun 26 02:41:27.509705 np0000003683 nova-compute[98991]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-02c8cec8-4a68-4b70-bfd0-ffc172bfbf0b, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:27.509705 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.534052 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.534052 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:27.534534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] <== disconnect_volume: return (3799ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:27.534534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:27.535064 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.934s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:27.535064 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:27.535337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.564905 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '8')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:27.565286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '7')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:27.566129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '8')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:27.566958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3e4cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:27.567123 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:41:27.567321 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flush multipath device 330000000b9eb3d9f {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:41:27.600961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:27.641234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:27.655573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:27.657191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:27.657191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:27.694554 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:41:27.694629 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:41:27.695805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:41:27.709632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:41:27.709832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:27.720865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.772658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:41:27.772658 np0000003683 nova-compute[98991]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:27.772658 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.794375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.810896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.849625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:41:27.849625 np0000003683 nova-compute[98991]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:27.849625 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.873204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.873302 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:27.873453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== disconnect_volume: return (1272ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:27.873829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:27.876417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.219s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:27.878951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:27.879799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5c22555b-891b-41d5-99e7-c4580b8a8840 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.437s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:27.881592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:27.896624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:27.900758 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:27.903491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:27.905041 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:27.908577 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:27.908988 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:27.923580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:27.923580 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.933281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:27.933281 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61] added
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:27.940502 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61] added
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:27.944373 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:27.944707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:27.945010 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:27.945164 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:27.964150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:27.964563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:27.986837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:27.987821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:27.988072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:27.988198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:27.988326 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:27.988447 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ee7e43fe-b6ed-4123-a49a-fe01175b42db req-b1da61b0-4b68-4a45-bd9c-628fe27b321b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state active and task_state resize_migrating.
Jun 26 02:41:28.039464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:28.040082 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:41:28.040606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:28.126621 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lazy-loading 'flavor' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:28.132791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:28.133099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk.config /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:28.157946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk.config /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config" returned: 0 in 0.024s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:28.158209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk.info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:28.181243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "cp -r /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_resize/disk.info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" returned: 0 in 0.023s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:28.416659 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Rebuilding instance
Jun 26 02:41:28.559968 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:28.606600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:28.606881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:28.940588 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:28.945568 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:28.950737 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:28.957549 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:28.963558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:28.970145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.980919 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.981213 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.987028 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:28.987396 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:29.022946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.40.100,3260]
Jun 26 02:41:29.022946 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:29.022946 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:29.034793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:29.035364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.50.100,3260]
Jun 26 02:41:29.035364 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:29.035364 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:29.049607 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.055872 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.056273 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:29.056508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:29.056641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:29.057838 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('7', '-', '-', 0) found on session 17 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:29.057954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.068963 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:29.069214 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:29.069402 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:29.069520 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:29.070507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] HCTL ('8', '-', '-', 0) found on session 18 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:29.070624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:29.075898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 17 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:29.076072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:29.087784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Searching for a device in session 18 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:29.087964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:29.109435 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Detaching volume d2343b0f-6823-48fb-9a33-c53eb2f50497
Jun 26 02:41:29.132247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a009d45e-8178-4b96-bb16-1716b5d8fda7 tempest-VolumesAssistedSnapshotsTest-942793496 tempest-VolumesAssistedSnapshotsTest-942793496-project-admin] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.722s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:29.173198 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Attempting to driver detach volume d2343b0f-6823-48fb-9a33-c53eb2f50497 from mountpoint /dev/sdc
Jun 26 02:41:29.177505 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Found disk sdc by alias ua-d2343b0f-6823-48fb-9a33-c53eb2f50497 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:41:29.178583 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Found disk sdc by alias ua-d2343b0f-6823-48fb-9a33-c53eb2f50497 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:41:29.178707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Attempting to detach device sdc from instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <alias name="ua-d2343b0f-6823-48fb-9a33-c53eb2f50497"/>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-8"/>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <target dev="sdc" bus="scsi"/>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <serial>d2343b0f-6823-48fb-9a33-c53eb2f50497</serial>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:29.178967 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:41:29.186538 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Successfully detached device sdc from instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 from the persistent domain config.
Jun 26 02:41:29.186679 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] (1/8): Attempting to detach device sdc with device alias ua-d2343b0f-6823-48fb-9a33-c53eb2f50497 from instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <alias name="ua-d2343b0f-6823-48fb-9a33-c53eb2f50497"/>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-8"/>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <target dev="sdc" bus="scsi"/>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <serial>d2343b0f-6823-48fb-9a33-c53eb2f50497</serial>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:29.186910 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:41:29.301806 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:29.302127 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:29.361513 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441689.3611622, 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 => ua-d2343b0f-6823-48fb-9a33-c53eb2f50497> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:41:29.364817 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-d2343b0f-6823-48fb-9a33-c53eb2f50497 for instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:41:29.367531 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Successfully detached device sdc from instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 from the live domain config.
Jun 26 02:41:29.368299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:29.368691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:29.368901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:29.371148 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Port 809bd0a4-ea36-4c23-a2fd-5cfa28760410 binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:41:29.538791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.586141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.589053 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.608538 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.613807 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.637245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.761406 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:29.761959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:29.762140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:29.762281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:29.762421 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:29.762567 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-50c4c636-a64a-4128-b5ed-99e66ca24b71 req-ebb5a31b-1205-450c-8e31-04d9594e67d4 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received unexpected event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with vm_state active and task_state rebuilding.
Jun 26 02:41:29.889682 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999648858 future=<Future at 0x72e29c396d50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:29.890992 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance destroyed successfully.
Jun 26 02:41:29.899378 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance destroyed successfully.
Jun 26 02:41:29.900568 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1837666838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:41:29.900832 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:29.901569 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:29.902000 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:41:29.909427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:29.910701 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.910860 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap757fd1af-c7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:29.912130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.912920 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:29.913944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.914825 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.915106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3496294-a9de-4e53-942a-3090eb71ecd7) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:29.915514 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.916027 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:29.916856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:29.919172 np0000003683 nova-compute[98991]: INFO os_vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7')
Jun 26 02:41:29.921530 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:29.921530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:29.921530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:30.095398 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:30.095706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:30.095934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:30.096096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:30.096158 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:30.096257 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-0af5ba7d-b25e-485f-b161-117e5f089802 req-bf7c7c56-ffd9-43cd-9cb8-a6a89f5291d1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state active and task_state resize_migrated.
Jun 26 02:41:30.379066 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:41:30.389012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:30.389184 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:30.389300 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:30.924694 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Found WWN 330000000246f8e78 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:30.925090 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:30.925258 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== connect_volume: return (3267ms) {'type': 'block', 'scsi_wwn': '330000000246f8e78', 'path': '/dev/dm-0', 'multipath_id': '330000000246f8e78'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:30.925439 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000246f8e78', 'path': '/dev/dm-0', 'multipath_id': '330000000246f8e78'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:30.926040 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.557s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:30.926613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2343b0f-6823-48fb-9a33-c53eb2f50497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:30.926822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:30.956512 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:30.957000 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:30.957699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:30.957934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '13')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:30.959048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497', '14')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:30.959945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c0860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:30.960169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:41:30.960439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Flush multipath device 330000000d82c0abd {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:41:30.992544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:31.057606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:31.076884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.077124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.077386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.077592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.077777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.080836 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Terminating instance
Jun 26 02:41:31.108328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:41:31.108576 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:41:31.110247 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:41:31.122954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:41:31.123283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:31.135581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.178121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.40.100,3260]
Jun 26 02:41:31.178121 np0000003683 nova-compute[98991]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:31.178121 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.196641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.207387 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.240903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.50.100,3260]
Jun 26 02:41:31.240903 np0000003683 nova-compute[98991]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d2343b0f-6823-48fb-9a33-c53eb2f50497, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:31.240903 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.258456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.258602 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:31.258744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] <== disconnect_volume: return (1890ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:31.258913 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:31.261592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.340s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:31.262114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:31.262435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:31.294980 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:31.295272 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:31.295439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:31.295439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '6')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:31.296369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '5')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:31.297163 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c47d120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:31.297335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:41:31.300054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flush multipath device 3300000006d49c7c2 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:41:31.372967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:31.398304 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:31.431178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:31.432693 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.432928 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.433518 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.434406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.434635 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.435111 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.435904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.436091 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.436579 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.437240 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.437406 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.437897 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.438635 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.439105 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.439925 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.443112 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.443112 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.443400 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.444202 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:31.444202 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.445003 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.445906 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lazy-loading 'pci_devices' on Instance uuid 3634e3e6-38af-4398-aaa3-e4cda9ac642e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:31.479027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:41:31.479326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:41:31.480507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:41:31.481678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.491333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:41:31.491573 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:31.502179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.535951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260]
Jun 26 02:41:31.535951 np0000003683 nova-compute[98991]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:31.535951 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.548961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:31.549615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:31.550251 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:31.551685 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.564449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.584243 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:41:31.602655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260]
Jun 26 02:41:31.602655 np0000003683 nova-compute[98991]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:31.602655 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.613401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.613401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.624532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:31.627905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:31.627905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== disconnect_volume: return (1703ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:31.627905 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:31.627905 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deleting instance files /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69_del
Jun 26 02:41:31.627905 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deletion of /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69_del complete
Jun 26 02:41:31.630467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.657141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.680695 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.683093 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.706529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.842028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:31.842538 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.842774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.842883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.843055 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:31.843376 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-5f88039d-c5dd-4125-9fc8-17ee993b784d req-56275e4a-34c1-4aa3-9c0c-f9f5ad6bfe13 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received unexpected event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with vm_state active and task_state rebuilding.
Jun 26 02:41:31.844839 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lazy-loading 'flavor' on Instance uuid 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:31.888630 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:31.888795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.890019 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.890019 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.890019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] No waiting events found dispatching network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:31.890019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-265f626d-cdc9-4003-9d4f-8237e49ee528 req-47ef0bde-5759-4b25-a63e-171f8aea5f93 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:41:31.923118 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99968111699991 future=<Future at 0x72e27c6968d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:31.924641 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Instance destroyed successfully.
Jun 26 02:41:31.925005 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lazy-loading 'resources' on Instance uuid 3e48fc5a-edf8-4497-8815-3430ef4d4391 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <uuid>3634e3e6-38af-4398-aaa3-e4cda9ac642e</uuid>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <name>instance-00000008</name>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:name>tempest-device-tagging-server-389598634</nova:name>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:18</nova:creationTime>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:user uuid="5ca66b021300400abc47122d1ff3006b">tempest-TaggedBootDevicesTest-1043317399-project-member</nova:user>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:project uuid="a07b56acd3834878b91328ea5bf2fb99">tempest-TaggedBootDevicesTest-1043317399</nova:project>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="dc1162a0-6944-4512-8fe0-85b1f5b087db">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="17dc09be-78c3-4d85-b3c7-945d44f5b867">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="0526e7f8-4e62-422b-b315-7fb06a018af2">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="c318b8cc-5e75-4e4e-bde6-e66a088b5f53">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="3c992a23-0d9c-4427-b13f-710d10309ee8">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.9" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="1932230d-5ed0-46f3-960f-26380b626a2d">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         <nova:port uuid="d34d2d35-a59e-42f8-8971-71b744a18144">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="serial">3634e3e6-38af-4398-aaa3-e4cda9ac642e</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="uuid">3634e3e6-38af-4398-aaa3-e4cda9ac642e</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/disk.config"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <alias name="ua-a899dbfa-c6ee-425d-97f1-1d232bf907f4"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-5"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <serial>a899dbfa-c6ee-425d-97f1-1d232bf907f4</serial>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <alias name="ua-710d7309-2205-437a-9456-e6d07c808eb1"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-9"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <serial>710d7309-2205-437a-9456-e6d07c808eb1</serial>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <alias name="ua-ed870baa-71ab-41d1-ae86-daa9f4a46c61"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="vdc" bus="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <serial>ed870baa-71ab-41d1-ae86-daa9f4a46c61</serial>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:3e:b2:18"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tapdc1162a0-69"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e1:aa:1c"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tap17dc09be-78"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:cd:e3:66"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tap0526e7f8-4e"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:11:9d:eb"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tapc318b8cc-5e"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:2e:34:c3"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tap3c992a23-0d"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:10:1f:a9"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tap1932230d-5e"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8c:eb:60"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <target dev="tapd34d2d35-a5"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/console.log" append="off"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:41:31.950117 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Preparing to wait for external event network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:31.954498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:31.955521 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:31.955521 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.955521 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.955521 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:31.956423 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.957128 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.957518 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:31.958498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.958850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bef3d51b-e28a-59f0-ad7e-0371a5b94746', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.959712 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.961018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:31.965696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.968236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.968453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc1162a0-69, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.968812 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc1162a0-69, col_values=(('qos', UUID('1c5c4ac4-19b6-46fa-b59d-11b7aa0bd81a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.969014 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc1162a0-69, col_values=(('external_ids', {'iface-id': 'dc1162a0-6944-4512-8fe0-85b1f5b087db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:b2:18', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.969851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.971228 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:31.980035 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.981278 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69')
Jun 26 02:41:31.981947 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:31.982101 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:31.982803 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:31.982803 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:31.982978 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.983134 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.983274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:31.984079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.984216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27624579-b473-5f6c-9dfc-c00efce3dc0e', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:31.985418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:31.985990 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:31.998669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.001132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.001348 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17dc09be-78, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.001697 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17dc09be-78, col_values=(('qos', UUID('96295b66-f35d-40c1-9bf6-3b174b0ab87d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.001841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17dc09be-78, col_values=(('external_ids', {'iface-id': '17dc09be-78c3-4d85-b3c7-945d44f5b867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:aa:1c', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.002553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.003601 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.019632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.021464 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78')
Jun 26 02:41:32.022242 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:32.024506 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.025086 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.025336 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:32.025699 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.025961 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.026123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:32.026979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.027120 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3300b11-d007-5669-92ef-a50f25f33d47', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.027788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.028758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.042197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.047170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.047435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0526e7f8-4e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.047828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0526e7f8-4e, col_values=(('qos', UUID('b5533a0f-9d29-4734-a6e5-76eb6353600e')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.047985 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0526e7f8-4e, col_values=(('external_ids', {'iface-id': '0526e7f8-4e62-422b-b315-7fb06a018af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e3:66', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.049003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.050846 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.052273 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:32.068757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.069761 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e')
Jun 26 02:41:32.070451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:32.070672 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.071180 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.071415 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:32.071635 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.071814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.071968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:32.072634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.072803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf4657f-ed0e-5699-ae0a-b60ee01bb24f', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.073432 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.074071 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.101365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.105753 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.106002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc318b8cc-5e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.106539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc318b8cc-5e, col_values=(('qos', UUID('a530a43a-77ca-4b52-9dea-fa119d6eb7ad')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.106780 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc318b8cc-5e, col_values=(('external_ids', {'iface-id': 'c318b8cc-5e75-4e4e-bde6-e66a088b5f53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9d:eb', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.107693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.109363 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.129386 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.130660 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e')
Jun 26 02:41:32.131326 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:32.131502 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.132058 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.132321 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:32.132641 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.137388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.137607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:32.138996 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.139966 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e13ee7cc-1a18-5ca9-a9e5-8164d68dd587', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.142244 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.143245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.169131 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.170687 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.170867 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c992a23-0d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.171141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c992a23-0d, col_values=(('qos', UUID('8a52d5c4-02a6-413c-b8cf-4280f1125dc1')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.171276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c992a23-0d, col_values=(('external_ids', {'iface-id': '3c992a23-0d9c-4427-b13f-710d10309ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:34:c3', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.172079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.173169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.200423 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.201330 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d')
Jun 26 02:41:32.202086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:32.202332 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.203286 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.203507 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:32.203745 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.203887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.204033 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:32.204921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.205057 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abd158ac-5255-54a2-9cf9-369d7cc33395', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.205653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.206283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.218944 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0c96a877-c722-4f5d-b621-6d2993d7ad69 could not be found.
Jun 26 02:41:32.223188 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:32.223188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:32.223816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:32.223816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:32.224700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:32.224700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:32.236950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.242109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.242304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1932230d-5e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.242674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1932230d-5e, col_values=(('qos', UUID('3254d44b-7e8f-43f0-84af-54233c6420e4')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.242813 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1932230d-5e, col_values=(('external_ids', {'iface-id': '1932230d-5ed0-46f3-960f-26380b626a2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:1f:a9', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.243636 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.245051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:32.256196 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:32.256437 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:32.256690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:32.256690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:32.257598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:41:32.257701 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:32.257837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:41:32.257945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c1120>, {}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:32.258077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Disconnecting from: [] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:32.258255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:32.258867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== disconnect_volume: return (35ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:32.259050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:32.281635 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.292129 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e')
Jun 26 02:41:32.295658 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:32.295846 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.296451 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.296749 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:32.297051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.297204 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.297342 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:32.300386 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.300598 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2c4bdff-5413-564a-a08b-bcce8bf0e009', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.301191 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.301758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.333976 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.336465 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.336705 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd34d2d35-a5, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.337014 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd34d2d35-a5, col_values=(('qos', UUID('38ff3469-bf4e-4caa-b42e-eeae33d16f4b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.337156 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd34d2d35-a5, col_values=(('external_ids', {'iface-id': 'd34d2d35-a59e-42f8-8971-71b744a18144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:eb:60', 'vm-uuid': '3634e3e6-38af-4398-aaa3-e4cda9ac642e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.338806 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.339945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.372426 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.373447 np0000003683 nova-compute[98991]: INFO os_vif [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5')
Jun 26 02:41:32.403185 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:32.429219 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1720807154',display_name='tempest-VolumesAssistedSnapshotsTest-server-1720807154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesassistedsnapshotstest-server-1720807154',id=4,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGqgJEZiBZAROjdBye9W1VCG2OQfiNIYgxc7W2d6SaE9371JZTo2Aq++O9KnKtDv9jZshSf9iks7qEmzWE3SgUeIBRvc1KdqHNzidh7np6Z1tw8U96Vdo/7DAPSz3QiIQ==',key_name='tempest-keypair-702548744',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:32Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eaae08be6c14d52b705eb1c0bb160bf',ramdisk_id='',reservation_id='r-4qt5ciwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-345586448',owner_user_name='tempest-VolumesAssistedSnapshotsTest-345586448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fb774f434487eae3283b5aef0251f',uuid=3e48fc5a-edf8-4497-8815-3430ef4d4391,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:41:32.429219 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converting VIF {"id": "bdbfe460-92fa-4088-82b9-636d21ff447c", "address": "fa:16:3e:22:69:18", "network": {"id": "a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1572177830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5eaae08be6c14d52b705eb1c0bb160bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbfe460-92", "ovs_interfaceid": "bdbfe460-92fa-4088-82b9-636d21ff447c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:32.429219 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:32.429219 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:41:32.430549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.430809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdbfe460-92, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.432043 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.433471 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.467166 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.467553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.467765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56fb2415-41c5-46d4-810c-d01cdb47482f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:32.468317 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.468942 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:32.504388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:32.507011 np0000003683 nova-compute[98991]: INFO os_vif [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:69:18,bridge_name='br-int',has_traffic_filtering=True,id=bdbfe460-92fa-4088-82b9-636d21ff447c,network=Network(a7b3f2cc-3d40-484e-82fc-7bb0a416bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbfe460-92')
Jun 26 02:41:32.507357 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Deleting instance files /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391_del
Jun 26 02:41:32.508206 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Deletion of /opt/stack/data/nova/instances/3e48fc5a-edf8-4497-8815-3430ef4d4391_del complete
Jun 26 02:41:32.567015 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:32.852110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02334086-7af7-4965-9f87-be27239d9bd7 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.245s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:33.013923 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Took 1.43 seconds to destroy the instance on the hypervisor.
Jun 26 02:41:33.014929 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:41:33.015077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:41:33.015182 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:41:33.015373 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:33.069404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:33.074686 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:33.109163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:33.109311 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:33.109498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:33.109633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:33.109745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:33.112974 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Terminating instance
Jun 26 02:41:33.417391 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Preparing to wait for external event volume-reimaged-58960a13-863b-468a-adc1-8bc8e1ea5fac {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:33.417556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:33.417653 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:33.417801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:33.576753 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:33.583459 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b6dda1a5-33f4-443b-8d09-4b9be356aae2 req-538bfa0d-e30f-4182-9f81-948dfb001319 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-deleted-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:33.583459 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-b6dda1a5-33f4-443b-8d09-4b9be356aae2 req-538bfa0d-e30f-4182-9f81-948dfb001319 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Neutron deleted interface bdbfe460-92fa-4088-82b9-636d21ff447c; detaching it from the instance and deleting it from the info cache
Jun 26 02:41:33.585199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b6dda1a5-33f4-443b-8d09-4b9be356aae2 req-538bfa0d-e30f-4182-9f81-948dfb001319 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Detach interface failed, port_id=bdbfe460-92fa-4088-82b9-636d21ff447c, reason: Instance 3e48fc5a-edf8-4497-8815-3430ef4d4391 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:41:33.589072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:33.608978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:33.621655 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:41:33.638070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:33.638343 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:33.646469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:33.647532 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::c25:3dff:fe93:246d', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fec0:70ce'] 
Jun 26 02:41:33.647692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:33.647869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:33.648151 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:33.712856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.721498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.741088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.749882 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.805496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.807222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:33.896574 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:33.896932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:33.897087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] No VIF found with MAC fa:16:3e:3e:b2:18, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:33.897373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] No VIF found with MAC fa:16:3e:2e:34:c3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:33.900203 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Using config drive
Jun 26 02:41:33.967849 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99954006500002 future=<Future at 0x72e29e7ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:33.969169 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Instance destroyed successfully.
Jun 26 02:41:33.969691 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lazy-loading 'resources' on Instance uuid 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:33.998287 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:33.998287 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] Acquiring lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:33.998287 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:33.999005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:33.999005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] No waiting events found dispatching network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:33.999005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cfec23a1-3242-4619-8eb5-04300dd394df req-93b57234-56bf-4414-a4dd-a41300d1b244 service nova] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Received event network-vif-unplugged-bdbfe460-92fa-4088-82b9-636d21ff447c for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:41:34.007453 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:34.007651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:34.007830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:34.007961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:34.008113 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] No waiting events found dispatching network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:34.008890 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abf32c2a-b17e-45dc-9952-ef4a9e841d3c req-a6322141-f3eb-439a-95f1-d9b616e35605 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:41:34.034105 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:34.412468 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:34.476977 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1071513237',display_name='tempest-AttachSCSIVolumeTestJSON-server-1071513237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachscsivolumetestjson-server-1071513237',id=5,image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdFTWZWsGITP5rtIeGL0d4qFOFm4vy2/AStH30gc9fQVB5bk3LySiDtt/Dg3ufE5jhPqa78f8gWOau9KQX/P94OJRRueR3jSRThluUhdQeieyYrKwHzRnj3SNbgeozw1A==',key_name='tempest-keypair-1977725589',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:37Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe57b3cf078f49879b9e2b586be5a31b',ramdisk_id='',reservation_id='r-3k10a3jf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bacaf0fe-7ee9-4f00-af1d-8cb159bfd225',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1987838335',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1987838335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f24f8637c0014a72b83f0b18bda326df',uuid=6cf8d36a-f984-44ac-8c51-7cda57e1afa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:41:34.476977 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converting VIF {"id": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "address": "fa:16:3e:6c:57:cd", "network": {"id": "13b32012-10f7-4cb6-bb01-b640aed1e819", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1462229703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fe57b3cf078f49879b9e2b586be5a31b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dfb6d2-be", "ovs_interfaceid": "55dfb6d2-becd-46d5-a95c-f02d0d21eadb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:34.476977 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:34.476977 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:41:34.476977 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.477205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55dfb6d2-be, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:34.492598 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.494160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:34.524077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.526002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.526143 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeb6b736-311d-45c9-a05c-cf1aaeb0fa6d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:34.526625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.527051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:34.539547 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Took 1.52 seconds to deallocate network for instance.
Jun 26 02:41:34.542258 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Creating config drive at /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/disk.config
Jun 26 02:41:34.550978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6t7wxcce {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:34.559325 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:34.565502 np0000003683 nova-compute[98991]: INFO os_vif [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:57:cd,bridge_name='br-int',has_traffic_filtering=True,id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb,network=Network(13b32012-10f7-4cb6-bb01-b640aed1e819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55dfb6d2-be')
Jun 26 02:41:34.565502 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Deleting instance files /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3_del
Jun 26 02:41:34.565502 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Deletion of /opt/stack/data/nova/instances/6cf8d36a-f984-44ac-8c51-7cda57e1afa3_del complete
Jun 26 02:41:34.586196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6t7wxcce" returned: 0 in 0.035s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:34.789146 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Starting finish_migration {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}}
Jun 26 02:41:34.790630 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:41:34.790756 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Creating image(s)
Jun 26 02:41:34.791641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:34.860266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.068s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:34.860693 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:41:34.860941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:34.926789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:34.927099 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Cannot resize image /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:41:35.012502 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.047991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:35.048334 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:35.072121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.073811 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.076808 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Took 1.45 seconds to destroy the instance on the hypervisor.
Jun 26 02:41:35.081738 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:41:35.081738 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:41:35.081738 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:41:35.081738 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:35.123504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.230601 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.261591 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.266337 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.290149 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.325506 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:35.329855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.371137 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.374783 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.396751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.417919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.430374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:41:35.430374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Ensure instance console log exists: /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:41:35.430722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:35.430923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:35.431795 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.432087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:35.436196 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start _get_guest_xml network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3ea56d66-80d7-478d-af2a-9c63241de580', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b5ffe1d6-9f45-40d3-bbfc-53dad7150a58', 'attached_at': '2026-06-26T02:41:34.000000', 'detached_at': '', 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'serial': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:35.444499 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:35.445511 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-273864534', uuid='b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'), owner=OwnerMeta(userid='bd70e26fc3b243ffb390cf119334c5e6', username='tempest-ServerActionsTestOtherB-315226471-project-member', projectid='fc72b1dff20e43d1b244280499fc5f65', projectname='tempest-ServerActionsTestOtherB-315226471'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441695.444969) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:35.450670 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:35.451064 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:35.451723 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.462398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:35.462837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:35.464537 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:35.464802 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:35.464961 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:35.465315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:35.465315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:35.465315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:35.465565 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:35.465686 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:35.465861 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:35.466004 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:35.466134 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:35.466253 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:35.481063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:35.496143 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.585909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.592326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:35.592326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:35.592326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:35.592326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:35.592326 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:35.592632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:35.592632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:35.651502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:35.651803 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:35.672175 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.683138 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.685527 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.705505 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.715751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.745582 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.821536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.949438 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.953647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.956798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:35.977176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.000992 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e4ae92a5-26f1-4d7a-9b31-e2de6ad8dd0f req-332a1dce-b418-4735-b86b-bafd44cbb3a8 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.000992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4ae92a5-26f1-4d7a-9b31-e2de6ad8dd0f req-332a1dce-b418-4735-b86b-bafd44cbb3a8 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.000992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4ae92a5-26f1-4d7a-9b31-e2de6ad8dd0f req-332a1dce-b418-4735-b86b-bafd44cbb3a8 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.000992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4ae92a5-26f1-4d7a-9b31-e2de6ad8dd0f req-332a1dce-b418-4735-b86b-bafd44cbb3a8 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.000992 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e4ae92a5-26f1-4d7a-9b31-e2de6ad8dd0f req-332a1dce-b418-4735-b86b-bafd44cbb3a8 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.090201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 in dict_keys([('network-vif-plugged', 'dc1162a0-6944-4512-8fe0-85b1f5b087db'), ('network-vif-plugged', '17dc09be-78c3-4d85-b3c7-945d44f5b867'), ('network-vif-plugged', 'c318b8cc-5e75-4e4e-bde6-e66a088b5f53'), ('network-vif-plugged', '3c992a23-0d9c-4427-b13f-710d10309ee8'), ('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-0526e7f8-4e62-422b-b315-7fb06a018af2 for instance with vm_state building and task_state spawning.
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.091389 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc9c5d92-5baf-454a-b3fd-8d355f88c18c req-f35490b8-5337-4887-b69a-bc83f50a2e9d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:36.115282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.115422 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Acquiring lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.115848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.116003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.116156 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] No waiting events found dispatching network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:36.116321 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-unplugged-55dfb6d2-becd-46d5-a95c-f02d0d21eadb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:41:36.116423 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.116565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.116676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.116784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.116938 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:36.116994 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.117081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.117178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.117279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.117399 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db in dict_keys([('network-vif-plugged', '17dc09be-78c3-4d85-b3c7-945d44f5b867'), ('network-vif-plugged', '3c992a23-0d9c-4427-b13f-710d10309ee8'), ('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:36.117532 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-dc1162a0-6944-4512-8fe0-85b1f5b087db for instance with vm_state building and task_state spawning.
Jun 26 02:41:36.117679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.117884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.118034 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.118177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.118329 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:36.118499 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.118648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.118800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.118932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.119182 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 in dict_keys([('network-vif-plugged', '3c992a23-0d9c-4427-b13f-710d10309ee8'), ('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:36.119333 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b5a8896c-ad41-4ae8-9736-af05ec08b0ec req-2f7287b1-428f-4244-be8f-30108fda8c1c service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 for instance with vm_state building and task_state spawning.
Jun 26 02:41:36.157178 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:36.205842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.361360 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.362495 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.435209 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2ca3ef6-d8ed-43b4-b6a2-c53f9bd3fb65 req-49e9e48f-0994-4fcd-ad7f-f03f70be5a55 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Received event network-vif-deleted-55dfb6d2-becd-46d5-a95c-f02d0d21eadb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:36.435209 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-e2ca3ef6-d8ed-43b4-b6a2-c53f9bd3fb65 req-49e9e48f-0994-4fcd-ad7f-f03f70be5a55 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Neutron deleted interface 55dfb6d2-becd-46d5-a95c-f02d0d21eadb; detaching it from the instance and deleting it from the info cache
Jun 26 02:41:36.439330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2ca3ef6-d8ed-43b4-b6a2-c53f9bd3fb65 req-49e9e48f-0994-4fcd-ad7f-f03f70be5a55 service nova] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Detach interface failed, port_id=55dfb6d2-becd-46d5-a95c-f02d0d21eadb, reason: Instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:41:36.468100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:36.468345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:36.484392 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.516054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.517104 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.590903 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441696.5905476, 3634e3e6-38af-4398-aaa3-e4cda9ac642e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:36.591204 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] VM Started (Lifecycle Event)
Jun 26 02:41:36.664555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.616s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:36.714386 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Deleted allocations for instance 3e48fc5a-edf8-4497-8815-3430ef4d4391
Jun 26 02:41:36.816212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.818123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.820601 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.847071 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:36.877393 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:36.970360 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:41:37.047907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:37.048785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:37.099766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:37.101268 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441697.1010754, 3634e3e6-38af-4398-aaa3-e4cda9ac642e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:37.101375 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] VM Paused (Lifecycle Event)
Jun 26 02:41:37.381008 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Took 2.30 seconds to deallocate network for instance.
Jun 26 02:41:37.531200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:37.531397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:37.533874 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:41:37.534006 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Claim successful on node np0000003683
Jun 26 02:41:37.552037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.959s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:37.552300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:37.566716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:37.567127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:37.568019 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:37.568385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:37.568574 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:37.568802 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:37.579411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:37.579411 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:37.585410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:37.585410 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:37.591458 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:37.591806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:37.591806 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:37.591967 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:37.598459 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:37.598869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:37.598869 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:37.599051 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:37.603394 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:37.604657 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:37.725985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b27df0b1-9393-4aba-9f0f-2667c4761b6d tempest-VolumesAssistedSnapshotsTest-345586448 tempest-VolumesAssistedSnapshotsTest-345586448-project-member] Lock "3e48fc5a-edf8-4497-8815-3430ef4d4391" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.649s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:37.888727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.070533 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.070760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.070923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.071336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.071468 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 in dict_keys([('network-vif-plugged', '3c992a23-0d9c-4427-b13f-710d10309ee8'), ('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:38.071625 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-46cadc08-ad4c-4f37-912d-afc64fd8a345 req-1f34e0f6-f331-49a2-a614-901f5dddffbb service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-d34d2d35-a59e-42f8-8971-71b744a18144 for instance with vm_state building and task_state spawning.
Jun 26 02:41:38.107195 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:41:38.162149 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.162753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.162945 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.163134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.163291 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 in dict_keys([('network-vif-plugged', '3c992a23-0d9c-4427-b13f-710d10309ee8'), ('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:38.163438 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-59f41162-eb87-4a0b-b2ae-cbac891e802b req-ccdde083-7296-4db1-926a-46da5e863c68 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 for instance with vm_state building and task_state spawning.
Jun 26 02:41:38.174847 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.175236 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.175396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.175531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.175652 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:38.175805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.176048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.176131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.176252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.176380 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No event matching network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 in dict_keys([('network-vif-plugged', '1932230d-5ed0-46f3-960f-26380b626a2d')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:41:38.176512 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-cba2c0d8-730a-46f4-a7e6-291be8f6bb32 req-25f1747b-c74f-40b8-b45d-4dc765c6b09a service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-3c992a23-0d9c-4427-b13f-710d10309ee8 for instance with vm_state building and task_state spawning.
Jun 26 02:41:38.517116 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.517423 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.517639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.517868 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.517974 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Processing event network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:38.518298 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:38.518457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:38.518626 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:38.518781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:38.518948 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:38.519100 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3c56bed8-1ab8-4ff4-947f-69700742cf3c req-ed3c494e-45c9-4146-9d0d-fc080a76ec65 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received unexpected event network-vif-plugged-1932230d-5ed0-46f3-960f-26380b626a2d for instance with vm_state building and task_state spawning.
Jun 26 02:41:38.519360 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:38.521932 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441698.5216527, 3634e3e6-38af-4398-aaa3-e4cda9ac642e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:38.522106 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] VM Resumed (Lifecycle Event)
Jun 26 02:41:38.524147 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:41:38.525585 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance spawned successfully.
Jun 26 02:41:38.526034 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:41:38.678908 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:38.685677 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:38.697230 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:38.703397 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.708719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.717911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.725877 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.726306 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.735020 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.735430 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:38.772752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:41:38.772752 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:38.772752 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.784736 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.797324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:41:38.797324 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:38.797324 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.808910 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.809235 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:38.809405 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:38.809461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:38.810597 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:38.812547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('11', '-', '-', 0) found on session 21 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:38.812547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:38.828130 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 21 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:38.829422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.831914 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:38.832339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:38.832762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:38.833335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('12', '-', '-', 0) found on session 22 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:38.833433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:38.851898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 22 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:38.852449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:39.026773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:39.036558 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.036766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.037151 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.037410 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.037728 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.038442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:39.039845 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:39.275831 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:39.276229 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:39.527012 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:39.544148 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:41:39.546275 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Took 29.05 seconds to spawn the instance on the hypervisor.
Jun 26 02:41:39.546505 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:39.680683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:39.779021 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:39.858509 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:40.056155 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Took 40.81 seconds to build instance.
Jun 26 02:41:40.287008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.755s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:40.287887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.401s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:40.288050 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:41:40.558221 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.324s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:40.696636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Found WWN 330000000b9eb3d9f for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:40.696636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.144s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:40.696636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== connect_volume: return (5103ms) {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-4', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:40.696636 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-4', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:40.763430 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:40.763681 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:40.796629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:41:40.796903 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:41:40.797172 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:40.797381 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:40.878244 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf673caf2b0442c9b6e0dbf43bcd6431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e603384bde4a58ba21e66722de0f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:41:41.204089 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:25Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:41.204305 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:41.204903 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <uuid>b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</uuid>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <name>instance-00000002</name>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <memory>262144</memory>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherB-server-273864534</nova:name>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:35</nova:creationTime>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.micro" id="84">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:memory>256</nova:memory>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:user uuid="bd70e26fc3b243ffb390cf119334c5e6">tempest-ServerActionsTestOtherB-315226471-project-member</nova:user>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:project uuid="fc72b1dff20e43d1b244280499fc5f65">tempest-ServerActionsTestOtherB-315226471</nova:project>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         <nova:port uuid="809bd0a4-ea36-4c23-a2fd-5cfa28760410">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="serial">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="uuid">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <alias name="ua-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <serial>7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc</serial>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:45:8c:a8"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <target dev="tap809bd0a4-ea"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/console.log" append="off"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:41:41.206163 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:41:41.209384 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:25Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:41.209384 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1691596142-network", "vif_mac": "fa:16:3e:45:8c:a8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:41.210314 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:41.210626 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:41.211673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.211673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:41.212207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:41.216670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.217096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '862b515f-9e0c-5c32-8d91-b062ba724b81', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:41.218288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.219595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:41.219833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.222937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.223246 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809bd0a4-ea, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:41.224293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap809bd0a4-ea, col_values=(('qos', UUID('50763349-c56b-488c-b356-c37becab5b39')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:41.224293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap809bd0a4-ea, col_values=(('external_ids', {'iface-id': '809bd0a4-ea36-4c23-a2fd-5cfa28760410', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:8c:a8', 'vm-uuid': 'b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:41.226073 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.226073 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:41.231595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.232844 np0000003683 nova-compute[98991]: INFO os_vif [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:41:41.266096 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:41.299245 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:41:41.329106 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-changed-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:41.329487 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing instance network info cache due to event network-changed-dc1162a0-6944-4512-8fe0-85b1f5b087db. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:41.329663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] Acquiring lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:41.329833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] Acquired lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:41.330010 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Refreshing network info cache for port dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:41.491697 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:41.582754 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005969769999865093 future=<Future at 0x72e29c2ea3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:41.583235 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782441686.5820115, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:41.583417 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:41.583669 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Stopped (Lifecycle Event)
Jun 26 02:41:41.584882 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.3044429429999127 future=<Future at 0x72e29c396d50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:41.585065 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.304251556999816 future=<Future at 0x72e29c396d50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:41.660906 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Successfully created port: f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:41.775502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.485s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:41.805592 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:41:41.833799 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:41.836929 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Deleted allocations for instance 6cf8d36a-f984-44ac-8c51-7cda57e1afa3
Jun 26 02:41:41.974991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:42.086604 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0469c5ce-6409-49c3-86c3-f9de40188d0f None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:42.088102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0469c5ce-6409-49c3-86c3-f9de40188d0f None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:42.213642 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:42.241303 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Successfully updated port: f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:42.304587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-changed-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:42.307411 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Refreshing instance network info cache due to event network-changed-f0c656c2-04a5-411f-9ace-648e2c7fa5e2. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:42.307411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] Acquiring lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:42.307411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] Acquired lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:42.307411 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Refreshing network info cache for port f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:42.369447 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updated VIF entry in instance network info cache for port dc1162a0-6944-4512-8fe0-85b1f5b087db. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:41:42.370253 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [{"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:42.447004 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:42.447611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:42.447611 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:42.597209 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0469c5ce-6409-49c3-86c3-f9de40188d0f None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 26 02:41:42.637041 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d6a052e-abb5-410e-b22a-847248f97dae req-827cc9d9-2008-4cdc-8b68-49e1dbd305da service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event volume-reimaged-58960a13-863b-468a-adc1-8bc8e1ea5fac {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:42.637191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d6a052e-abb5-410e-b22a-847248f97dae req-827cc9d9-2008-4cdc-8b68-49e1dbd305da service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:42.637380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d6a052e-abb5-410e-b22a-847248f97dae req-827cc9d9-2008-4cdc-8b68-49e1dbd305da service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:42.637526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d6a052e-abb5-410e-b22a-847248f97dae req-827cc9d9-2008-4cdc-8b68-49e1dbd305da service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:42.637658 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d6a052e-abb5-410e-b22a-847248f97dae req-827cc9d9-2008-4cdc-8b68-49e1dbd305da service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Processing event volume-reimaged-58960a13-863b-468a-adc1-8bc8e1ea5fac {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:42.638559 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance event wait completed in 8 seconds for volume-reimaged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:42.743869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:42.752319 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:42.752497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:42.752827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:42.752827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] No VIF found with MAC fa:16:3e:45:8c:a8, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:42.753239 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Using config drive
Jun 26 02:41:42.811881 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:42.822998 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:41:42.822998 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:41:42.822998 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Creating image(s)
Jun 26 02:41:42.822998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:42.823251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:42.823866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:42.824367 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:42.829750 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:42.829750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:42.855924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e9f5cbe-42d4-49b5-b2c2-fad68776c182 tempest-AttachSCSIVolumeTestJSON-1987838335 tempest-AttachSCSIVolumeTestJSON-1987838335-project-member] Lock "6cf8d36a-f984-44ac-8c51-7cda57e1afa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.746s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:42.878574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8186cf47-7beb-48f0-9eba-c35645816644 req-895a9e62-da4f-4e42-9a0e-0d6e878530b5 service nova] Releasing lock "refresh_cache-3634e3e6-38af-4398-aaa3-e4cda9ac642e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:42.898001 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:42.917800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:42.918282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:42.918751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:42.919234 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:42.922427 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:41:42.922824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:42.954341 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:42.996757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.073s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:42.996757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:43.041171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk 1073741824" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:43.041789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:43.042203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:43.108071 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:43.123925 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:43.124285 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:41:43.124495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:43.141571 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'pci_requests' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:43.146669 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Booting with volume 58960a13-863b-468a-adc1-8bc8e1ea5fac at /dev/vda
Jun 26 02:41:43.195986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:43.196356 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Cannot resize image /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:41:43.196680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:41:43.196838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Ensure instance console log exists: /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:41:43.197100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:43.197346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:43.197528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:43.209904 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:43.222805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:43.240942 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.263639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:43.279202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.301031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:43.301237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:43.309808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:43.312570 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fec0:70ce', 'fe80::fc16:3eff:fe3e:b218', 'fe80::fc16:3eff:fee1:aa1c', 'fe80::cb2:9cff:fe41:6a4f', 'fe80::fc16:3eff:fecd:e366', 'fe80::fc16:3eff:fe11:9deb', 'fe80::fc16:3eff:fe2e:34c3', 'fe80::fc16:3eff:fe10:1fa9', 'fe80::641d:eff:fe76:4352', 'fe80::fc16:3eff:fe8c:eb60', 'fe80::4070:b5ff:fe67:f54a', 'fe80::fc16:3eff:fe45:8ca8'] 
Jun 26 02:41:43.312683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:43.312789 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:43.313048 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:43.313279 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating existing volume attachment record: eb838fb3-7fec-4643-9a31-849543af4516 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:43.357324 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.480600 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:43.481561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:43.485161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:43.485161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:43.485161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:43.485161 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-130f6c82-bc74-459b-b9b7-2cd9faddd28c req-dc7ceaee-a70c-4dd4-ba7b-8a7440bb8312 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state active and task_state resize_finish.
Jun 26 02:41:43.601465 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.603149 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.605955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.607544 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.611870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a3d9570d-6071-42c9-8d13-38653dfb0fae req-3f2d1a6c-6cf9-4083-ad21-579a4e9b0a55 service nova] Releasing lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:43.612030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquired lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:43.612282 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:43.629321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:43.649282 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Object Instance<9bc60ab4-5d7c-4f30-876b-9b9451b446f2> lazy-loaded attributes: flavor,pci_requests {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:41:43.649494 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:41:43.649947 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:43.650274 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:43.739440 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bb1094ab9904a39a5c111c76c89104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d8ccf228940a5af4ec7724cc6700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:41:44.023496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:44.172788 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441704.172337, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:44.173350 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Resumed (Lifecycle Event)
Jun 26 02:41:44.175029 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:44.180275 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance running successfully.
Jun 26 02:41:44.182690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Failed to set time: agent not configured {{(pid=98991) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 26 02:41:44.182979 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-262f8b49-a82f-4d92-8a7a-3945489ccc54 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] finish_migration finished successfully. {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}}
Jun 26 02:41:44.187064 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:41:44.214882 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Successfully created port: 48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:41:44.371189 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:44.543498 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updating instance_info_cache with network_info: [{"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:44.677677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:44.679300 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:44.840869 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Successfully updated port: 48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:41:44.890665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-changed-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:44.891549 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0021961310001188394 future=<Future at 0x72e29c396d50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:44.891681 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:44.892843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing instance network info cache due to event network-changed-48de6e51-680d-40f0-bad7-16b554f379d9. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:44.892843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:44.892843 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.030568475000109 future=<Future at 0x72e27c6968d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:44.892843 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.0304549239999687 future=<Future at 0x72e27c6968d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:44.894389 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Emitting event <LifecycleEvent: 1782441689.8892248, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:44.894389 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Stopped (Lifecycle Event)
Jun 26 02:41:44.895733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:44.895733 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Refreshing network info cache for port 48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:45.045447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Releasing lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:45.045763 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance network_info: |[{"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:41:45.047573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Start _get_guest_xml network_info=[{"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:45.049343 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:45.050561 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1309385917', uuid='57def865-dcb9-4373-9cd5-4437010c97be'), owner=OwnerMeta(userid='cf673caf2b0442c9b6e0dbf43bcd6431', username='tempest-VolumesExtendAttachedTest-1696909639-project-member', projectid='07e603384bde4a58ba21e66722de0f69', projectname='tempest-VolumesExtendAttachedTest-1696909639'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441705.0501945) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:45.051308 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:45.051659 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:45.052470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:45.052630 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:45.053419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:45.053753 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:45.053887 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:45.053997 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:45.054111 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:45.054190 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:45.054274 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:45.054401 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:45.054530 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:45.054647 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:45.054788 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:45.054904 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:45.066333 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1309385917',display_name='tempest-VolumesExtendAttachedTest-instance-1309385917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesextendattachedtest-instance-1309385917',id=10,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXXVbs9JH4HdnJZTQA/jFcqKB4QJKjEq6USWFRBeWTMqtIauiJt2WlicGd4WFgEYO2wsOlsU/HTZDM7HFfx2oSFSzEOGmlxEudRj8zNIyfAvS1sm0SalP/XxIDBDs9X/A==',key_name='tempest-keypair-881985731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07e603384bde4a58ba21e66722de0f69',ramdisk_id='',reservation_id='r-d55pfd68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1696909639',owner_user_name='tempest-VolumesExtendAttachedTest-1696909639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf673caf2b0442c9b6e0dbf43bcd6431',uuid=57def865-dcb9-4373-9cd5-4437010c97be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:45.066509 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converting VIF {"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:45.067128 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:45.067614 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lazy-loading 'pci_devices' on Instance uuid 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:45.182075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 26 02:41:45.182406 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441705.1821644, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:45.182581 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Started (Lifecycle Event)
Jun 26 02:41:45.342949 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:45.398254 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:45.402594 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:45.454559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:41:45.454964 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating image(s)
Jun 26 02:41:45.455125 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:41:45.455207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Ensure instance console log exists: /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:41:45.455411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:45.455792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:45.455912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:45.456294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start _get_guest_xml network_info=[{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T02:38:04Z,direct_url=<?>,disk_format='qcow2',id=57a87e28-af94-43db-b1e9-25ce405e5cef,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-26T02:38:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eb838fb3-7fec-4643-9a31-849543af4516', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0c96a877-c722-4f5d-b621-6d2993d7ad69', 'attached_at': '', 'detached_at': '', 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'serial': '58960a13-863b-468a-adc1-8bc8e1ea5fac'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:45.457435 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jun 26 02:41:45.458306 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='57a87e28-af94-43db-b1e9-25ce405e5cef', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1837666838', uuid='0c96a877-c722-4f5d-b621-6d2993d7ad69'), owner=OwnerMeta(userid='3a64b2d42a9c4039ac9d0a0bb79b951a', username='tempest-ServerActionsV293TestJSON-213768761-project-member', projectid='604c96beaf0646b38621c7b79c2968bd', projectname='tempest-ServerActionsV293TestJSON-213768761'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441705.4580657) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:45.462400 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:45.462921 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:45.466069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T02:38:04Z,direct_url=<?>,disk_format='qcow2',id=57a87e28-af94-43db-b1e9-25ce405e5cef,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-26T02:38:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:45.469500 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c96a877-c722-4f5d-b621-6d2993d7ad69 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:45.566516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:45.568643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:45.568721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:45.568902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:45.569064 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:45.569232 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-63579a98-1161-47b0-80e8-5b70ebcc1821 req-6159359a-b317-4f6a-b048-9f7fa75a9865 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state resized and task_state None.
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <uuid>57def865-dcb9-4373-9cd5-4437010c97be</uuid>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <name>instance-0000000a</name>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1309385917</nova:name>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:45</nova:creationTime>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:user uuid="cf673caf2b0442c9b6e0dbf43bcd6431">tempest-VolumesExtendAttachedTest-1696909639-project-member</nova:user>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:project uuid="07e603384bde4a58ba21e66722de0f69">tempest-VolumesExtendAttachedTest-1696909639</nova:project>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         <nova:port uuid="f0c656c2-04a5-411f-9ace-648e2c7fa5e2">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="serial">57def865-dcb9-4373-9cd5-4437010c97be</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="uuid">57def865-dcb9-4373-9cd5-4437010c97be</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.config"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8e:e9:c4"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <target dev="tapf0c656c2-04"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/console.log" append="off"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:41:45.571057 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Preparing to wait for external event network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1309385917',display_name='tempest-VolumesExtendAttachedTest-instance-1309385917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesextendattachedtest-instance-1309385917',id=10,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXXVbs9JH4HdnJZTQA/jFcqKB4QJKjEq6USWFRBeWTMqtIauiJt2WlicGd4WFgEYO2wsOlsU/HTZDM7HFfx2oSFSzEOGmlxEudRj8zNIyfAvS1sm0SalP/XxIDBDs9X/A==',key_name='tempest-keypair-881985731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07e603384bde4a58ba21e66722de0f69',ramdisk_id='',reservation_id='r-d55pfd68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1696909639',owner_user_name='tempest-VolumesExtendAttachedTest-1696909639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf673caf2b0442c9b6e0dbf43bcd6431',uuid=57def865-dcb9-4373-9cd5-4437010c97be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:45.572983 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converting VIF {"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:45.573388 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:45.573532 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:45.574421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:45.574421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:45.574421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:45.576637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:45.576637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9869b3b-585c-52d4-8f67-103ff2e8a09b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:45.577462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:45.579881 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:45.581343 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0c656c2-04, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:45.581343 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0c656c2-04, col_values=(('qos', UUID('c1e7c5ca-05ec-4076-86df-9bea61a816f9')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:45.581343 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0c656c2-04, col_values=(('external_ids', {'iface-id': 'f0c656c2-04a5-411f-9ace-648e2c7fa5e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:e9:c4', 'vm-uuid': '57def865-dcb9-4373-9cd5-4437010c97be'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:45.586075 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:45.603970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:45.605755 np0000003683 nova-compute[98991]: INFO os_vif [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04')
Jun 26 02:41:45.685128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:45.692171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:45.700064 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:45.864736 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Added VIF to instance network info cache for port 48de6e51-680d-40f0-bad7-16b554f379d9. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}}
Jun 26 02:41:45.865051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:45.978976 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:45.979230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:45.979350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:45.979723 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:45.979938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:45.991149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:45.991842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:45.992829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:45.993006 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:45.993383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:45.993612 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:46.005114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:46.005114 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:46.009493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:46.009493 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac] added
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:46.017227 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:46.017491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:46.017724 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:46.017929 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac] added
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:46.021959 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:46.022255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:46.022322 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:46.022486 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:46.106404 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:46.195841 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 26 02:41:46.221246 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:46.221638 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:46.221925 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:46.283900 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Port 809bd0a4-ea36-4c23-a2fd-5cfa28760410 binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:41:46.284039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:46.284131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:46.284265 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:46.367631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7b832d6a-62fe-4f8c-b98b-3f40286931a0 req-ab027fc5-c246-47fa-83f5-91b34ad37c43 service nova] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:46.367937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:46.368113 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:46.493642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:46.786186 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:46.923132 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003375369999503164 future=<Future at 0x72e27c6968d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:46.923219 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:46.923303 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.0439030190000267 future=<Future at 0x72e29e7ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:46.923395 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.0438136529999156 future=<Future at 0x72e29e7ea3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:46.924131 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Emitting event <LifecycleEvent: 1782441691.9226997, 3e48fc5a-edf8-4497-8815-3430ef4d4391 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:46.924316 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] VM Stopped (Lifecycle Event)
Jun 26 02:41:46.970752 np0000003683 nova-compute[98991]: WARNING nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] 6d73c96d-7add-4b92-94ef-f7051403c5ee already exists in list: networks containing: ['6d73c96d-7add-4b92-94ef-f7051403c5ee']. ignoring it
Jun 26 02:41:46.970937 np0000003683 nova-compute[98991]: WARNING nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] 48de6e51-680d-40f0-bad7-16b554f379d9 already exists in list: port_ids containing: ['48de6e51-680d-40f0-bad7-16b554f379d9']. ignoring it
Jun 26 02:41:47.018554 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:47.023114 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:47.034176 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:47.042623 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.052610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.061678 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.069562 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.083237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.083531 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:47.118226 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260]
Jun 26 02:41:47.118226 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:47.118226 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.129553 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:47.130256 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:47.130256 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No VIF found with MAC fa:16:3e:8e:e9:c4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:47.131901 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Using config drive
Jun 26 02:41:47.134065 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260]
Jun 26 02:41:47.134065 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:47.134065 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.140332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.151260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:47.161365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:47.165999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:47.167772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] HCTL ('9', '-', '-', 0) found on session 23 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:47.168043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.174675 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:47.175374 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:47.176073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:47.176073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:47.183291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] HCTL ('10', '-', '-', 0) found on session 24 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:47.183397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:47.200893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching for a device in session 23 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:47.200893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:47.200893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Searching for a device in session 24 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:47.200893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:47.255456 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:47.264505 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:47.340575 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:47.427935 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 3e48fc5a-edf8-4497-8815-3430ef4d4391] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:47.463171 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:47.612515 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:47.645008 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:47.786852 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:47.807372 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Creating config drive at /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.config
Jun 26 02:41:47.813441 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nkrem_v {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:47.867986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nkrem_v" returned: 0 in 0.054s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:47.965877 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:47.993927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:48.289183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:48.292218 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:48.292438 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:48.293153 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:48.293451 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:48.293933 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.294395 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:48.294842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:48.297180 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.297415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf7790f6-5153-5b84-8802-1809d7ed4a81', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:48.299247 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:48.304876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.308016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.308239 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48de6e51-68, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:48.308613 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48de6e51-68, col_values=(('qos', UUID('b0ea45b1-eaa7-49fb-8ac6-5dfd5884a75d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:48.308836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48de6e51-68, col_values=(('external_ids', {'iface-id': '48de6e51-680d-40f0-bad7-16b554f379d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:71:fe', 'vm-uuid': '9bc60ab4-5d7c-4f30-876b-9b9451b446f2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:48.310241 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.311808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:48.321746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.322976 np0000003683 nova-compute[98991]: INFO os_vif [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68')
Jun 26 02:41:48.323718 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:48.323968 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:48.324383 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] attach device xml: <interface type="ethernet">
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:   <mac address="fa:16:3e:bb:71:fe"/>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:   <model type="virtio"/>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:   <driver name="qemu"/>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:   <mtu size="1372"/>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:   <target dev="tap48de6e51-68"/>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]: </interface>
Jun 26 02:41:48.326137 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:41:48.351528 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.417497 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.428854 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.432240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.452516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.470141 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Creating tmpfile /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/tmpv6a_xgka to verify with other compute node that the instance is on the same shared storage. {{(pid=98991) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10568}}
Jun 26 02:41:48.470402 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:41:48.540133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.643117 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4060650-c578-41b1-a84c-66f2f5042779 req-8809c0d5-9125-4d2a-951b-7ddda44807a9 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:48.643880 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4060650-c578-41b1-a84c-66f2f5042779 req-8809c0d5-9125-4d2a-951b-7ddda44807a9 service nova] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:48.644125 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4060650-c578-41b1-a84c-66f2f5042779 req-8809c0d5-9125-4d2a-951b-7ddda44807a9 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:48.644291 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4060650-c578-41b1-a84c-66f2f5042779 req-8809c0d5-9125-4d2a-951b-7ddda44807a9 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:48.644453 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4060650-c578-41b1-a84c-66f2f5042779 req-8809c0d5-9125-4d2a-951b-7ddda44807a9 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Processing event network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:41:48.679746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.743256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.746103 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.752271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.773836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:48.774028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:48.774255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:48.774315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:48.774428 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:48.774599 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9c5627bf-f2b0-4eb4-9496-f03e76a2dfbd req-5d300bcb-4728-460d-98b8-23dfb08d9324 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received unexpected event network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 for instance with vm_state active and task_state None.
Jun 26 02:41:48.785170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:48.967700 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00042934799989780004 future=<Future at 0x72e29e7ea3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:48.968674 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:48.971560 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-819c0b29-492e-4607-9d65-1c72face958a None None] Emitting event <LifecycleEvent: 1782441693.9671338, 6cf8d36a-f984-44ac-8c51-7cda57e1afa3 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:48.971560 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-819c0b29-492e-4607-9d65-1c72face958a None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] VM Stopped (Lifecycle Event)
Jun 26 02:41:49.003295 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.008901 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.013743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Found WWN 3300000006d49c7c2 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:49.014279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:49.014279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000006d49c7c2', 'path': '/dev/dm-1', 'multipath_id': '3300000006d49c7c2'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:49.014279 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d49c7c2', 'path': '/dev/dm-1', 'multipath_id': '3300000006d49c7c2'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:49.037520 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.252168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.262395 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.267947 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.300205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.308147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.356210 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999696515000096 future=<Future at 0x72e29c4af350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:49.356836 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998762237000165 future=<Future at 0x72e29c4af350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:49.356956 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998620894000169 future=<Future at 0x72e29c4af350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:41:49.359339 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance destroyed successfully.
Jun 26 02:41:49.361309 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'resources' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:49.372236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:49.372520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:49.372786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:49.372972 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:49.373219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:49.373397 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-eec85a52-92dd-4be7-87a6-3c3f1934904b req-3ade16c4-f948-448b-ad14-0d825472ed5a service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state resized and task_state resize_reverting.
Jun 26 02:41:49.436357 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.463168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.464464 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.476258 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-819c0b29-492e-4607-9d65-1c72face958a None None] [instance: 6cf8d36a-f984-44ac-8c51-7cda57e1afa3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:49.534289 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1837666838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:41:49.534409 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:49.535083 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <uuid>0c96a877-c722-4f5d-b621-6d2993d7ad69</uuid>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <name>instance-00000006</name>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1837666838</nova:name>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:45</nova:creationTime>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:image uuid="57a87e28-af94-43db-b1e9-25ce405e5cef">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:user uuid="3a64b2d42a9c4039ac9d0a0bb79b951a">tempest-ServerActionsV293TestJSON-213768761-project-member</nova:user>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:project uuid="604c96beaf0646b38621c7b79c2968bd">tempest-ServerActionsV293TestJSON-213768761</nova:project>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid="57a87e28-af94-43db-b1e9-25ce405e5cef"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         <nova:port uuid="757fd1af-c79d-456e-b641-1382ec7a0b5a">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="serial">0c96a877-c722-4f5d-b621-6d2993d7ad69</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="uuid">0c96a877-c722-4f5d-b621-6d2993d7ad69</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <alias name="ua-58960a13-863b-468a-adc1-8bc8e1ea5fac"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <serial>58960a13-863b-468a-adc1-8bc8e1ea5fac</serial>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:ef:93:bf"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <target dev="tap757fd1af-c7"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/console.log" append="off"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:41:49.536456 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:41:49.539112 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1837666838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:41:49.539112 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:49.539112 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:49.539112 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:41:49.540642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.540642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.540642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:41:49.541725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.541725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b37e8087-1b00-5866-92b8-dea455426ae8', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.542181 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.543182 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:49.566452 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:49.566824 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441709.5665944, 57def865-dcb9-4373-9cd5-4437010c97be => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:49.566949 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] VM Started (Lifecycle Event)
Jun 26 02:41:49.571602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:41:49.573388 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance spawned successfully.
Jun 26 02:41:49.574418 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:41:49.624172 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.626887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.628161 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.628314 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap757fd1af-c7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.628673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap757fd1af-c7, col_values=(('qos', UUID('9cfe0bfa-6abc-4077-a4c8-70eab7667569')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.628850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap757fd1af-c7, col_values=(('external_ids', {'iface-id': '757fd1af-c79d-456e-b641-1382ec7a0b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:93:bf', 'vm-uuid': '0c96a877-c722-4f5d-b621-6d2993d7ad69'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.629878 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.633500 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:49.640083 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.641420 np0000003683 nova-compute[98991]: INFO os_vif [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7')
Jun 26 02:41:49.863293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:44Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:41:49.863835 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:41:49.864095 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:41:49.864319 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:41:49.865993 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.866279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809bd0a4-ea, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.867554 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.868564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:49.874666 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.876076 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.876351 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50763349-c56b-488c-b356-c37becab5b39) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:41:49.877004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.877726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:41:49.882788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:49.886220 np0000003683 nova-compute[98991]: INFO os_vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:41:49.887281 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:41:49.887763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:49.887921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:49.888763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:49.889199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:41:49.889379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:49.916591 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:49.916934 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:49.917143 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:41:49.917143 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '21')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:49.918558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '22')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:41:49.919960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c27e840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:41:49.920350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:41:49.920757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flush multipath device 330000000b9eb3d9f {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:41:49.969263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:50.018102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:41:50.065391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:41:50.065391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:41:50.065391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:41:50.067601 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:50.067601 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:50.067601 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No VIF found with MAC fa:16:3e:15:2a:85, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:50.072094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:50.080556 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:50.083932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:41:50.084699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:41:50.086495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.086674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.087082 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.087382 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.089038 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.091615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:50.097204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.142203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:41:50.142203 np0000003683 nova-compute[98991]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:50.142203 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.160497 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.173104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.208787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:41:50.208787 np0000003683 nova-compute[98991]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:50.208787 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.230169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:50.230169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:50.230169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== disconnect_volume: return (342ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:50.230169 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:41:50.249062 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.250209 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.250523 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.250894 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.251201 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.251466 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.251822 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.251988 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.252136 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:41:50.252284 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:41:50.573249 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-102461132', uuid='9bc60ab4-5d7c-4f30-876b-9b9451b446f2'), owner=OwnerMeta(userid='9bb1094ab9904a39a5c111c76c89104a', username='tempest-TaggedAttachmentsTest-1104328228-project-member', projectid='e41d8ccf228940a5af4ec7724cc6700b', projectname='tempest-TaggedAttachmentsTest-1104328228'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441710.572736) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:41:50</nova:creationTime>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     <nova:port uuid="48de6e51-680d-40f0-bad7-16b554f379d9">
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:41:50.574035 np0000003683 nova-compute[98991]:  {{(pid=98991) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 26 02:41:50.585470 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:41:50.585820 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441710.5855694, 57def865-dcb9-4373-9cd5-4437010c97be => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:50.585954 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] VM Paused (Lifecycle Event)
Jun 26 02:41:50.596178 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Took 7.78 seconds to spawn the instance on the hypervisor.
Jun 26 02:41:50.596352 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:50.739371 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:50.740265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:50.740265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:50.740265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:50.740265 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] No waiting events found dispatching network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:50.740265 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-2a9136bb-4232-4b0b-b2e5-5677e6af3346 req-1fc47cdb-1a67-4a06-b75f-b2379e114256 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received unexpected event network-vif-plugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 for instance with vm_state active and task_state None.
Jun 26 02:41:50.756741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:50.756981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:50.757084 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:50.757248 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:41:50.857540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:50.857718 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:50.857850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:50.857989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:50.858111 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:50.858202 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-0804db82-014e-4866-9e82-8936c1361d2c req-3e2d7f4d-9cb8-4620-8b5c-6f42bfb6221f service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received unexpected event network-vif-plugged-48de6e51-680d-40f0-bad7-16b554f379d9 for instance with vm_state active and task_state None.
Jun 26 02:41:51.079948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e60303ed-4104-45ec-9b36-5e57a9d9464b tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.632s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:51.090229 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:51.097610 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441711.097066, 57def865-dcb9-4373-9cd5-4437010c97be => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:51.097610 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] VM Resumed (Lifecycle Event)
Jun 26 02:41:51.115942 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Took 13.64 seconds to build instance.
Jun 26 02:41:51.162121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:51.162319 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:41:51.162498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] No VIF found with MAC fa:16:3e:ef:93:bf, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:41:51.163021 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Using config drive
Jun 26 02:41:51.177866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:51.374532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:51.374786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:51.447211 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:51.447416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:51.447589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:51.447736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:51.447886 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:51.448088 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c415c2bb-2a94-4621-be4f-2a2a199e0880 req-9a725235-0032-46ce-9ca4-db654840d72b service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state resized and task_state resize_reverting.
Jun 26 02:41:51.497511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:51.600567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:51.604947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:51.618388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-02862c9b-e413-4dec-b2de-13cc5ebbdb4b tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.150s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:51.666161 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0c96a877-c722-4f5d-b621-6d2993d7ad69 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:51.787122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:51.865778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:51.866416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:51.884210 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'migration_context' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:51.948899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:51.953209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.033340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.037499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.117610 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.120541 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000006, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config'
Jun 26 02:41:52.125127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:41:52.125127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:41:52.125127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:41:52.125127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.172061 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Object Instance<0c96a877-c722-4f5d-b621-6d2993d7ad69> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:41:52.172061 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lazy-loading 'keypairs' on Instance uuid 0c96a877-c722-4f5d-b621-6d2993d7ad69 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:52.208942 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.210630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.239735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:52.240367 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:52.312077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.315078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.393962 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Object Instance<b5ffe1d6-9f45-40d3-bbfc-53dad7150a58> lazy-loaded attributes: resources,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:41:52.431728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.432449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.524578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.529314 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:52.530990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.568727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.037s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.569151 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51408MB free_disk=74.37296676635742GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:41:52.569376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:52.682327 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Object Instance<0c96a877-c722-4f5d-b621-6d2993d7ad69> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:41:52.687789 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
Jun 26 02:41:52.748897 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:52.872309 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Creating config drive at /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config
Jun 26 02:41:52.877467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmm5cvdd {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:52.933491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmm5cvdd" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:52.938243 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-changed-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:52.939558 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Refreshing instance network info cache due to event network-changed-f0c656c2-04a5-411f-9ace-648e2c7fa5e2. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:41:52.939933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] Acquiring lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:52.940096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] Acquired lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:52.940788 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Refreshing network info cache for port f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:41:53.016053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:53.016600 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:53.097049 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.414413 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.443701 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:53.445765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.470650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.519512 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:53.531740 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.762083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:53.767953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.778851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.781628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.806465 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:53.823433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:53.824465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:53.825172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:53.825172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:53.825172 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:53.825172 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-6e5fc5bd-8ba8-4a40-b488-578cd37e074a req-0304fd86-7246-48fb-868a-303d730adad2 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received unexpected event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with vm_state active and task_state rebuild_spawning.
Jun 26 02:41:53.864126 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:54.025824 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updated VIF entry in instance network info cache for port f0c656c2-04a5-411f-9ace-648e2c7fa5e2. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:41:54.026092 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updating instance_info_cache with network_info: [{"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:54.162198 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:54.336557 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:41:54.336835 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:41:54.338652 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441714.3373404, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:54.338652 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Resumed (Lifecycle Event)
Jun 26 02:41:54.344967 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance spawned successfully.
Jun 26 02:41:54.345332 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:41:54.528060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e93dfc13-bdcc-4844-914a-5d56b0fa1b94 req-94ae2508-4ae3-43a9-9c37-afcdcf7fd7d4 service nova] Releasing lock "refresh_cache-57def865-dcb9-4373-9cd5-4437010c97be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:54.538277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:54.538558 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:41:54.544265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.975s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:54.844879 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:54.845635 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:54.845818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:54.846083 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Attaching volume ed6ecbe9-5f95-4313-a1ab-88a873fccf4d to /dev/vdb
Jun 26 02:41:54.852246 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:54.855387 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.855538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.855937 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.856210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.856524 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.857059 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:41:54.878095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:54.914225 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:54.926105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:54.947378 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:54.973120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:54.973370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:54.982303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:54.984601 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fec0:70ce', 'fe80::fc16:3eff:fe3e:b218', 'fe80::fc16:3eff:fee1:aa1c', 'fe80::cb2:9cff:fe41:6a4f', 'fe80::fc16:3eff:fecd:e366', 'fe80::fc16:3eff:fe11:9deb', 'fe80::fc16:3eff:fe2e:34c3', 'fe80::fc16:3eff:fe10:1fa9', 'fe80::641d:eff:fe76:4352', 'fe80::fc16:3eff:fe8c:eb60', 'fe80::4070:b5ff:fe67:f54a', 'fe80::fc16:3eff:febb:71fe', 'fe80::fc16:3eff:fe8e:e9c4', 'fe80::a022:60ff:fe70:a535', 'fe80::405:99ff:fea9:f963', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa'] 
Jun 26 02:41:54.984763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:54.984843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:54.985049 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:54.985272 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating existing volume attachment record: c633136a-b669-487f-b652-2c403a8f4bc8 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:41:55.355945 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jun 26 02:41:55.355945 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441715.3543177, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:41:55.355945 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Started (Lifecycle Event)
Jun 26 02:41:55.362791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:55.494808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:55.535700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:55.536166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:55.536166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:55.536503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:55.536768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:55.549262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:55.549823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:55.550064 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:55.550904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:55.551357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:55.551566 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:55.563324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:55.563324 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:55.571540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:55.571540 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d] added
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:55.580197 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:55.580613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:55.580645 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:55.583502 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d] added
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:55.587845 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:55.615369 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:55.615999 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0c96a877-c722-4f5d-b621-6d2993d7ad69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:55.615999 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:55.615999 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 3634e3e6-38af-4398-aaa3-e4cda9ac642e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:55.615999 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:55.857518 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:41:55.862528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:41:55.878284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:55.916310 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:41:55.919498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:55.919498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:55.919498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:55.919498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:41:55.919498 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c5beb2e4-feab-4128-b47b-7d151b3d56d2 req-b8ca6fcb-5869-4e0a-8dbd-4de78ae81e65 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received unexpected event network-vif-plugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with vm_state active and task_state None.
Jun 26 02:41:56.117933 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 47177ad8-834c-43b6-bb58-9edefb6e4c82 has allocations against this compute host but is not found in the database.
Jun 26 02:41:56.118099 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:56.118239 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 57def865-dcb9-4373-9cd5-4437010c97be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:41:56.118533 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 7 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:41:56.118732 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1920MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:41:52 up 28 min,  2 users,  load average: 7.96, 4.00, 1.86\n', 'num_instances': '7', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_os_type_None': '7', 'num_proj_fc72b1dff20e43d1b244280499fc5f65': '1', 'io_workload': '0', 'num_vm_active': '6', 'num_task_None': '5', 'num_proj_f3004e12281740988b4f5119899f222b': '2', 'num_proj_e41d8ccf228940a5af4ec7724cc6700b': '1', 'num_proj_a07b56acd3834878b91328ea5bf2fb99': '1', 'num_proj_07e603384bde4a58ba21e66722de0f69': '1', 'num_task_rebuild_spawning': '1', 'num_proj_604c96beaf0646b38621c7b79c2968bd': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:41:56.143018 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Swapping old allocation on dict_keys(['af1bc8b6-4321-4361-b703-e0f6b10a10af']) held by migration 47177ad8-834c-43b6-bb58-9edefb6e4c82 for instance
Jun 26 02:41:56.261912 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Overwriting current allocation {'allocations': {'af1bc8b6-4321-4361-b703-e0f6b10a10af': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 14}}, 'project_id': 'fc72b1dff20e43d1b244280499fc5f65', 'user_id': 'bd70e26fc3b243ffb390cf119334c5e6', 'consumer_generation': 1} on consumer b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
Jun 26 02:41:56.435593 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:56.499445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:56.535193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:41:56.535358 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquired lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:41:56.535548 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:41:56.582011 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:56.589322 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:56.598262 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:41:56.602278 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.616660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.628890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.630495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:41:56.630861 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.635075 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.635410 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.647088 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.647494 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:56.678021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.50.100,3260]
Jun 26 02:41:56.678021 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.50.100,3260] successful.
Jun 26 02:41:56.678021 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.692946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.701936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.40.100,3260]
Jun 26 02:41:56.701936 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.40.100,3260] successful.
Jun 26 02:41:56.701936 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.710440 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.710722 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:56.710921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:56.711045 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:56.712136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] HCTL ('11', '-', '-', 0) found on session 25 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:56.712287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:56.716453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:56.730094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Searching for a device in session 25 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:56.730094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.738127 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:56.739270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:41:56.739777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] HCTL ('12', '-', '-', 0) found on session 26 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:41:56.739878 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:41:56.754919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Searching for a device in session 26 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:41:56.754919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:41:56.888888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:56.889099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:57.037564 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:57.134571 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:41:57.391267 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:41:57.396062 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:41:57.533525 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:41:57.552474 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:41:57.642678 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:41:57.643659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.099s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:57.644177 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.70 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:41:57.644646 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.766s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:57.645450 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98991) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
Jun 26 02:41:57.960037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:58.036732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Releasing lock "refresh_cache-b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:41:58.036732 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:58.047616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:41:58.070277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:58.083725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:58.100982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:41:58.101986 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:41:58.111784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:41:58.114196 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fec0:70ce', 'fe80::fc16:3eff:fe3e:b218', 'fe80::fc16:3eff:fee1:aa1c', 'fe80::cb2:9cff:fe41:6a4f', 'fe80::fc16:3eff:fecd:e366', 'fe80::fc16:3eff:fe11:9deb', 'fe80::fc16:3eff:fe2e:34c3', 'fe80::fc16:3eff:fe10:1fa9', 'fe80::641d:eff:fe76:4352', 'fe80::fc16:3eff:fe8c:eb60', 'fe80::4070:b5ff:fe67:f54a', 'fe80::fc16:3eff:febb:71fe', 'fe80::fc16:3eff:fe8e:e9c4', 'fe80::a022:60ff:fe70:a535', 'fe80::405:99ff:fea9:f963', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa'] 
Jun 26 02:41:58.114375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:41:58.114714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:41:58.115062 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:58.567888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Found WWN 330000000ea6ac18b for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:41:58.568255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:41:58.568395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000ea6ac18b', 'path': '/dev/dm-4', 'multipath_id': '330000000ea6ac18b'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:41:58.568529 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea6ac18b', 'path': '/dev/dm-4', 'multipath_id': '330000000ea6ac18b'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:41:58.570546 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:58.656914 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9d6a052e-abb5-410e-b22a-847248f97dae tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.013s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:58.658069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.698s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:58.660716 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:41:58.660883 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Claim successful on node np0000003683
Jun 26 02:41:59.073459 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Attempting to attach volume ed6ecbe9-5f95-4313-a1ab-88a873fccf4d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:   <alias name="ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d"/>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:   <serial>ed6ecbe9-5f95-4313-a1ab-88a873fccf4d</serial>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:41:59.074375 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:41:59.221225 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Starting finish_revert_migration {{(pid=98991) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12953}}
Jun 26 02:41:59.234579 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start _get_guest_xml network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bb24815a-0adf-4dde-931c-d8d68ccc362f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b5ffe1d6-9f45-40d3-bbfc-53dad7150a58', 'attached_at': '2026-06-26T02:41:58.000000', 'detached_at': '', 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'serial': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:41:59.236958 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:41:59.237915 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-273864534', uuid='b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'), owner=OwnerMeta(userid='bd70e26fc3b243ffb390cf119334c5e6', username='tempest-ServerActionsTestOtherB-315226471-project-member', projectid='fc72b1dff20e43d1b244280499fc5f65', projectname='tempest-ServerActionsTestOtherB-315226471'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441719.2375295) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:41:59.238810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:41:59.239141 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:41:59.241047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:41:59.241047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:41:59.241047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:41:59.241204 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:41:59.241301 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:41:59.241578 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:41:59.241578 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:41:59.241860 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:41:59.241860 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:41:59.241966 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:41:59.242022 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:41:59.242133 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:41:59.242423 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:41:59.242423 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:41:59.242624 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:41:59.772142 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:41:59.850782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:41:59.851386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:41:59.851717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:41:59.856871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:41:59.856871 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:41:59.861883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:41:59.862375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:59.865381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:59.865381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:41:59.876073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:59.876831 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:41:59.877315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:59.877574 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:41:59.878105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:41:59.878324 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:41:59.879693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:41:59.890913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:59.890913 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:59.896221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:41:59.896221 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:59.902637 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:59.902895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:59.903053 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:59.903218 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc] added
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:41:59.909648 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:41:59.909927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:41:59.910139 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:41:59.910307 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:00.133032 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:00.133233 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:00.240526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:00.240847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:00.636106 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:00.745755 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'flavor' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:00.780672 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:00.781120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:00.781120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] No VIF found with MAC fa:16:3e:15:2a:85, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:00.903660 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:00.910699 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:00.917147 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:00.923190 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:00.929391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:00.937553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.948867 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.949373 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.954447 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:00.954803 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:01.003863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:42:01.003863 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:01.003863 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:01.008383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:42:01.008383 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:01.008383 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:01.017714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:01.025270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.041816 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:01.042345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:01.042797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:01.043716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('15', '-', '-', 0) found on session 27 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:01.043819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.045206 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:01.045591 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:01.045972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:01.045972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:01.047044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] HCTL ('16', '-', '-', 0) found on session 28 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:01.047170 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:01.057718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 27 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:01.057957 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:01.065588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Searching for a device in session 28 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:01.066010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:01.145261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.487s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:01.145768 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:01.501304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:01.654586 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:01.654586 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:01.654586 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:01.654586 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:01.749304 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dc1fc159eb74ea9848a9474ebe3e07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0e893087347008612ce6860ab8b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:01.751364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:01.879111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:42:02.587668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:02.587668 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:02.587668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-122fd8ec-ead6-43c5-9b81-3d7bee8e3335 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.521s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:02.587668 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Successfully created port: e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:02.661860 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:02.844377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:02.844513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:02.844750 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attaching volume dd66945d-daf7-47e8-8d54-bac6019b1708 to /dev/vdb
Jun 26 02:42:02.898279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Found WWN 330000000b9eb3d9f for multipath device dm-8 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:42:02.898885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:02.898885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-8', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:02.899154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9eb3d9f', 'path': '/dev/dm-8', 'multipath_id': '330000000b9eb3d9f'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:42:02.902081 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:02.920233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:42:02.946704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:02.986106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:42:02.986599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:42:02.997521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:42:03.000133 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fec0:70ce', 'fe80::fc16:3eff:fe3e:b218', 'fe80::fc16:3eff:fee1:aa1c', 'fe80::cb2:9cff:fe41:6a4f', 'fe80::fc16:3eff:fecd:e366', 'fe80::fc16:3eff:fe11:9deb', 'fe80::fc16:3eff:fe2e:34c3', 'fe80::fc16:3eff:fe10:1fa9', 'fe80::641d:eff:fe76:4352', 'fe80::fc16:3eff:fe8c:eb60', 'fe80::4070:b5ff:fe67:f54a', 'fe80::fc16:3eff:febb:71fe', 'fe80::fc16:3eff:fe8e:e9c4', 'fe80::a022:60ff:fe70:a535', 'fe80::405:99ff:fea9:f963', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa'] 
Jun 26 02:42:03.000239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:42:03.000375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:42:03.000817 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:03.001097 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating existing volume attachment record: 1628a810-31a2-400c-9024-f6d6bee46252 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:42:03.038594 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Successfully updated port: e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:03.098046 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-changed-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:03.098260 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Refreshing instance network info cache due to event network-changed-e61d109d-7b8a-4b6b-b076-43079b449229. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:03.100030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] Acquiring lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:03.100152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] Acquired lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:03.100377 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Refreshing network info cache for port e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:03.409503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:44Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:03.409503 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:03.409503 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <uuid>b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</uuid>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <name>instance-00000002</name>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherB-server-273864534</nova:name>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:41:59</nova:creationTime>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:user uuid="bd70e26fc3b243ffb390cf119334c5e6">tempest-ServerActionsTestOtherB-315226471-project-member</nova:user>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:project uuid="fc72b1dff20e43d1b244280499fc5f65">tempest-ServerActionsTestOtherB-315226471</nova:project>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         <nova:port uuid="809bd0a4-ea36-4c23-a2fd-5cfa28760410">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="serial">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="uuid">b5ffe1d6-9f45-40d3-bbfc-53dad7150a58</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/disk.config"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <alias name="ua-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-8"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <serial>7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc</serial>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:45:8c:a8"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <target dev="tap809bd0a4-ea"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58/console.log" append="off"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:03.413370 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Preparing to wait for external event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:44Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:03.421557 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:03.422454 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:03.422846 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.424535 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:03.424535 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:03.427027 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.427027 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '862b515f-9e0c-5c32-8d91-b062ba724b81', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:03.429959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.432019 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:03.441781 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.444025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.444223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809bd0a4-ea, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:03.444649 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap809bd0a4-ea, col_values=(('qos', UUID('39e844ff-c9ef-43a4-bcf8-16f19ff576ce')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:03.444870 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap809bd0a4-ea, col_values=(('external_ids', {'iface-id': '809bd0a4-ea36-4c23-a2fd-5cfa28760410', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:8c:a8', 'vm-uuid': 'b5ffe1d6-9f45-40d3-bbfc-53dad7150a58'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:03.446280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.448521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:03.456498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.457528 np0000003683 nova-compute[98991]: INFO os_vif [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:42:03.540884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:03.574645 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:42:03.575038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:03.575200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:03.575694 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:03.575898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:42:03.591437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:03.591570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:03.591866 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:03.592404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:03.593031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:03.593031 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:03.606022 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:03.608748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:03.608748 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:03.609375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:03.609375 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708] added
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:03.626589 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:03.627287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:03.627287 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:03.627354 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708] added
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:03.627910 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:03.628105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:03.628296 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:03.628507 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:03.650409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.668914 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:03.669873 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:03.670090 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Creating image(s)
Jun 26 02:42:03.673789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:03.673963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:03.674410 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:03.675010 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:03.678811 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:03.681139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:03.709220 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:03.763039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:03.766102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:03.766601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:03.767076 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:03.770688 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:03.771249 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:03.864318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:03.865191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:03.906237 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk 1073741824" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:03.907152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:03.908009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:03.937192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:03.967845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:03.998071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:04.002084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.003522 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:04.004036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:04.028582 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.104774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:04.105256 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Cannot resize image /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:04.105753 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:04.105953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Ensure instance console log exists: /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:04.106278 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:04.106552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:04.106736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:04.107373 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.317062 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.319213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.322244 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.343122 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:04.356149 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005163409998658608 future=<Future at 0x72e29c4af350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:04.356294 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:04.356788 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Emitting event <LifecycleEvent: 1782441709.3555002, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:04.356961 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Stopped (Lifecycle Event)
Jun 26 02:42:04.441933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bf33da0c-2731-4cde-b8ab-c7a4ed04deab req-bef2ace9-666b-4e8d-9cf5-964999c72536 service nova] Releasing lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:04.442491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquired lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:04.442755 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:04.627892 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:04.629058 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:04.642627 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:04.653486 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.664111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.675960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.683234 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.683520 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.694261 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.694554 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:04.744070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260]
Jun 26 02:42:04.744070 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:04.744070 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.755364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260]
Jun 26 02:42:04.755364 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:04.755364 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.760312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.769612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:04.771638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:04.771884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.786616 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:04.787104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:04.787596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:04.788803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('19', '-', '-', 0) found on session 29 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:04.788917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.794551 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:04.794973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:04.796070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('20', '-', '-', 0) found on session 30 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:04.796165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:04.820856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 29 and hctl ['19', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:04.820856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 30 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:04.820856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:04.840061 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 due to new event <LifecycleEvent: 1782441724.8397338, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Started> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:42:04.840348 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441724.8397338, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:04.840490 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Started (Lifecycle Event)
Jun 26 02:42:04.861125 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7a8fc646-2a60-4e1a-aa0f-292994f4f86f tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:05.019332 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:05.173273 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:05.275590 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Detaching volume ed6ecbe9-5f95-4313-a1ab-88a873fccf4d
Jun 26 02:42:05.313087 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Updating instance_info_cache with network_info: [{"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:05.324740 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Attempting to driver detach volume ed6ecbe9-5f95-4313-a1ab-88a873fccf4d from mountpoint /dev/vdb
Jun 26 02:42:05.328706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Found disk vdb by alias ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:42:05.330171 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Found disk vdb by alias ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:42:05.330344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Attempting to detach device vdb from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <alias name="ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d"/>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <serial>ed6ecbe9-5f95-4313-a1ab-88a873fccf4d</serial>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:05.330728 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:05.338267 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully detached device vdb from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the persistent domain config.
Jun 26 02:42:05.338449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] (1/8): Attempting to detach device vdb with device alias ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <alias name="ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d"/>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <serial>ed6ecbe9-5f95-4313-a1ab-88a873fccf4d</serial>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:05.338790 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:05.342995 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:05.344320 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441725.3441055, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:05.344453 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Paused (Lifecycle Event)
Jun 26 02:42:05.811096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 29 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:05.811096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:05.816109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Releasing lock "refresh_cache-7dc03f57-e6ba-46ce-8935-335dfd3ce307" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:05.816420 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance network_info: |[{"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:05.817834 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Start _get_guest_xml network_info=[{"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:05.821533 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:05.823147 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-869322397', uuid='7dc03f57-e6ba-46ce-8935-335dfd3ce307'), owner=OwnerMeta(userid='6dc1fc159eb74ea9848a9474ebe3e07a', username='tempest-ServersNegativeTestJSON-731616508-project-member', projectid='a8e0e893087347008612ce6860ab8b9b', projectname='tempest-ServersNegativeTestJSON-731616508'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441725.8226993) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:05.824450 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:05.824883 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:05.825755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:05.825911 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:05.826932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:05.827288 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:05.827446 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:05.827583 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:05.827716 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:05.827798 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:05.827885 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:05.828026 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:05.828124 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:05.828220 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:05.828342 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:05.828467 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:05.840871 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-869322397',display_name='tempest-ServersNegativeTestJSON-server-869322397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-869322397',id=11,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-7o60mx6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:03Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=7dc03f57-e6ba-46ce-8935-335dfd3ce307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:05.841202 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:05.841920 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:05.842554 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dc03f57-e6ba-46ce-8935-335dfd3ce307 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:05.846796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:05.848489 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:05.940648 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d for instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <uuid>7dc03f57-e6ba-46ce-8935-335dfd3ce307</uuid>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <name>instance-0000000b</name>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServersNegativeTestJSON-server-869322397</nova:name>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:05</nova:creationTime>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:user uuid="6dc1fc159eb74ea9848a9474ebe3e07a">tempest-ServersNegativeTestJSON-731616508-project-member</nova:user>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:project uuid="a8e0e893087347008612ce6860ab8b9b">tempest-ServersNegativeTestJSON-731616508</nova:project>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         <nova:port uuid="e61d109d-7b8a-4b6b-b076-43079b449229">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="serial">7dc03f57-e6ba-46ce-8935-335dfd3ce307</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="uuid">7dc03f57-e6ba-46ce-8935-335dfd3ce307</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.config"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:7b:13:b5"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <target dev="tape61d109d-7b"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/console.log" append="off"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:06.345261 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Preparing to wait for external event network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-869322397',display_name='tempest-ServersNegativeTestJSON-server-869322397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-869322397',id=11,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-7o60mx6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:03Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=7dc03f57-e6ba-46ce-8935-335dfd3ce307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:06.347631 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:06.348545 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:06.348835 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:06.350577 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.350917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:06.353494 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 26 02:42:06.353622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:06.354867 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.355107 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aebe81c4-fe08-5245-b03b-0360f07881df', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:06.355722 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441726.355125, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => ua-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:42:06.357099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.357099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:06.358630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.361554 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully detached device vdb from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the live domain config.
Jun 26 02:42:06.361901 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.362089 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape61d109d-7b, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:06.362726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape61d109d-7b, col_values=(('qos', UUID('6367a99d-ada0-41ab-a80a-f8251ccb9770')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:06.363126 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:06.363856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape61d109d-7b, col_values=(('external_ids', {'iface-id': 'e61d109d-7b8a-4b6b-b076-43079b449229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:13:b5', 'vm-uuid': '7dc03f57-e6ba-46ce-8935-335dfd3ce307'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:06.364133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:06.364743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:06.367785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.367785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:06.371650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.372633 np0000003683 nova-compute[98991]: INFO os_vif [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b')
Jun 26 02:42:06.503192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:06.610962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found WWN 330000000ce24fb25 for multipath device dm-10 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:42:06.610962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:06.611409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000ce24fb25', 'path': '/dev/dm-10', 'multipath_id': '330000000ce24fb25'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:06.611409 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce24fb25', 'path': '/dev/dm-10', 'multipath_id': '330000000ce24fb25'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:42:06.611854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.247s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:06.612355 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:06.612606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:06.613619 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'flavor' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:06.649266 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:06.649572 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:06.649826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '30')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:06.649826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', '26')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:06.651223 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d', '25')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:06.652285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c47c040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'): ({'sdf'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:06.652540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:06.652845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Flush multipath device 330000000ea6ac18b {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:06.694454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:06.741280 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:06.796136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:06.796388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:06.798496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:06.808617 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:06.808932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:06.822983 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.866763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.40.100,3260]
Jun 26 02:42:06.866763 np0000003683 nova-compute[98991]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:06.866763 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.891157 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.902972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.947312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.50.100,3260]
Jun 26 02:42:06.947312 np0000003683 nova-compute[98991]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ed6ecbe9-5f95-4313-a1ab-88a873fccf4d, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:06.947312 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.970307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:06.970620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:06.970844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] <== disconnect_volume: return (606ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:06.970985 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:07.116866 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attempting to attach volume dd66945d-daf7-47e8-8d54-bac6019b1708 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:   <alias name="ua-dd66945d-daf7-47e8-8d54-bac6019b1708"/>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:   <serial>dd66945d-daf7-47e8-8d54-bac6019b1708</serial>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:07.118143 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:42:07.532137 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:07.703334 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:42:07.832661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:07.889407 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:07.889577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:07.889757 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No VIF found with MAC fa:16:3e:7b:13:b5, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:07.890194 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Using config drive
Jun 26 02:42:08.395658 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:08.578639 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Creating config drive at /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.config
Jun 26 02:42:08.582921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8y64c87e {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:08.624040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8y64c87e" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:08.785201 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:08.785381 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:08.785565 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:08.785746 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:c0:70:ce, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:09.034301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-48de6e51-680d-40f0-bad7-16b554f379d9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:09.034644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-48de6e51-680d-40f0-bad7-16b554f379d9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:09.048371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1264880e-b08d-438a-9bd4-8465549c0c82 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.275s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:09.080794 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.114705 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.202229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.426531 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af0d88e9-3206-4d80-979f-6dec06d922fc req-68ec9f2d-5f36-4cf8-9cd9-788c766df24f service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:09.427145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af0d88e9-3206-4d80-979f-6dec06d922fc req-68ec9f2d-5f36-4cf8-9cd9-788c766df24f service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:09.427362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af0d88e9-3206-4d80-979f-6dec06d922fc req-68ec9f2d-5f36-4cf8-9cd9-788c766df24f service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:09.427555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af0d88e9-3206-4d80-979f-6dec06d922fc req-68ec9f2d-5f36-4cf8-9cd9-788c766df24f service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:09.427750 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af0d88e9-3206-4d80-979f-6dec06d922fc req-68ec9f2d-5f36-4cf8-9cd9-788c766df24f service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Processing event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:09.428966 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:09.431982 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441729.4315906, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:09.432201 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Resumed (Lifecycle Event)
Jun 26 02:42:09.437691 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance running successfully.
Jun 26 02:42:09.437691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] finish_revert_migration finished successfully. {{(pid=98991) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12999}}
Jun 26 02:42:09.440638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.448349 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.469532 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.529160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:09.541441 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:09.935911 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:09.937842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:10.046514 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:10.046514 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:10.048122 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:10.049369 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:10.050614 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:10.051628 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Attempting to detach device tap48de6e51-68 from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] detach device xml: <interface type="ethernet">
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:   <mac address="fa:16:3e:bb:71:fe"/>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:   <model type="virtio"/>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:   <driver name="qemu"/>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:   <mtu size="1372"/>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:   <target dev="tap48de6e51-68"/>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]: </interface>
Jun 26 02:42:10.051945 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:10.055927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface>not found in domain: <domain type='qemu' id='7'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <name>instance-00000007</name>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <uuid>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</uuid>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:41:50</nova:creationTime>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <nova:port uuid="48de6e51-680d-40f0-bad7-16b554f379d9">
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <memory unit='KiB'>196608</memory>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <vcpu placement='static'>1</vcpu>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <resource>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <partition>/machine</partition>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </resource>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <sysinfo type='smbios'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='product'>OpenStack Nova</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='version'>33.1.0</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='serial'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='uuid'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <entry name='family'>Virtual Machine</entry>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <boot dev='hd'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <smbios mode='sysinfo'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <vmcoreinfo state='on'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <cpu mode='custom' match='exact' check='full'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <model fallback='forbid'>Nehalem</model>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <feature policy='require' name='hypervisor'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <clock offset='utc'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <on_poweroff>destroy</on_poweroff>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <on_reboot>restart</on_reboot>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <on_crash>destroy</on_crash>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <disk type='file' device='disk'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk' index='2'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <backingStore type='file' index='3'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:         <format type='raw'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:         <source file='/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:         <backingStore/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       </backingStore>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target dev='vda' bus='virtio'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='virtio-disk0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <disk type='file' device='cdrom'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <driver name='qemu' type='raw' cache='none'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config' index='1'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <backingStore/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target dev='hda' bus='ide'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <readonly/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='ide0-0-0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <controller type='usb' index='0' model='none'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='usb'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <controller type='pci' index='0' model='pci-root'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='pci.0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <controller type='ide' index='0'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='ide'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <interface type='ethernet'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <mac address='fa:16:3e:15:2a:85'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target dev='tap0bd9217b-5a'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <model type='virtio'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <driver name='qemu'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <mtu size='1372'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='net0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <interface type='ethernet'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <mac address='fa:16:3e:bb:71:fe'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target dev='tap48de6e51-68'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <model type='virtio'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <driver name='qemu'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <mtu size='1372'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='net1'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <serial type='pty'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target type='isa-serial' port='0'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:         <model name='isa-serial'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       </target>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <console type='pty' tty='/dev/pts/5'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <target type='serial' port='0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </console>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <input type='mouse' bus='ps2'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='input0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <input type='keyboard' bus='ps2'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='input1'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <listen type='address' address='0.0.0.0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <audio id='1' type='none'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <model type='virtio' heads='1' primary='yes'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='video0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <stats period='10'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='balloon0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <rng model='virtio'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <backend model='random'>/dev/urandom</backend>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <alias name='rng0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <label>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</label>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <imagelabel>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</imagelabel>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <label>+64055:+993</label>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:     <imagelabel>+64055:+993</imagelabel>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:10.057457 np0000003683 nova-compute[98991]:  {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully detached device tap48de6e51-68 from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the persistent domain config.
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] (1/8): Attempting to detach device tap48de6e51-68 with device alias net1 from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] detach device xml: <interface type="ethernet">
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:   <mac address="fa:16:3e:bb:71:fe"/>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:   <model type="virtio"/>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:   <driver name="qemu"/>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:   <mtu size="1372"/>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:   <target dev="tap48de6e51-68"/>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]: </interface>
Jun 26 02:42:10.062006 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:10.353591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d49928db-48be-4acb-a277-836baede5734 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:10.440092 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 26 02:42:10.440349 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441730.4401546, 7dc03f57-e6ba-46ce-8935-335dfd3ce307 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:10.440515 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] VM Started (Lifecycle Event)
Jun 26 02:42:10.497638 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-03709875-448e-4620-8cf2-bef7dd17990f tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance to original state: 'active'
Jun 26 02:42:10.905721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:10.905721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:10.929773 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:10.932436 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:10.937214 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Start waiting for the detach event from libvirt for device tap48de6e51-68 with device alias net1 for instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:42:10.945428 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:10.947314 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441730.947055, 7dc03f57-e6ba-46ce-8935-335dfd3ce307 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:10.947461 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] VM Paused (Lifecycle Event)
Jun 26 02:42:10.950709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:10.957757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:11.145873 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7a25dbba-1cfd-4fdb-8464-5ed8c2111aa7 req-ea7fa9c4-6d29-4c63-847b-dc60f82b96f9 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received unexpected event network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 for instance with vm_state active and task_state None.
Jun 26 02:42:11.364662 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.451682 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:11.454562 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:11.506359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.516342 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:11.516342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:11.516502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:11.516647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:11.516784 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:11.516903 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received unexpected event network-vif-plugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with vm_state active and task_state deleting.
Jun 26 02:42:11.517003 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:11.518794 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:11.518929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:11.519113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:11.519255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Processing event network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:11.519384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:11.519572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:11.519785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:11.519883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:11.520133 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] No waiting events found dispatching network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:11.522816 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f3fdf3d5-60b2-438c-8b8d-20715ece61aa req-dc00b707-3391-49fb-9f81-466e69757d82 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received unexpected event network-vif-plugged-e61d109d-7b8a-4b6b-b076-43079b449229 for instance with vm_state building and task_state spawning.
Jun 26 02:42:11.523952 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:11.527332 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:11.529097 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance spawned successfully.
Jun 26 02:42:11.530085 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:11.887205 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Rebuilding instance
Jun 26 02:42:11.957086 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:42:11.957607 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441731.9569483, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:42:11.957745 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:11.958040 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441731.9578204, 7dc03f57-e6ba-46ce-8935-335dfd3ce307 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:11.958168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] VM Resumed (Lifecycle Event)
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface>not found in domain: <domain type='qemu' id='7'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <name>instance-00000007</name>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <uuid>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</uuid>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:41:50</nova:creationTime>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <nova:port uuid="48de6e51-680d-40f0-bad7-16b554f379d9">
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.10.10.251" ipVersion="4"/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <memory unit='KiB'>196608</memory>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <vcpu placement='static'>1</vcpu>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <resource>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <partition>/machine</partition>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </resource>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <sysinfo type='smbios'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='product'>OpenStack Nova</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='version'>33.1.0</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='serial'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='uuid'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <entry name='family'>Virtual Machine</entry>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <boot dev='hd'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <smbios mode='sysinfo'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <vmcoreinfo state='on'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <cpu mode='custom' match='exact' check='full'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <model fallback='forbid'>Nehalem</model>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <feature policy='require' name='hypervisor'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <clock offset='utc'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <on_poweroff>destroy</on_poweroff>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <on_reboot>restart</on_reboot>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <on_crash>destroy</on_crash>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <disk type='file' device='disk'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk' index='2'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <backingStore type='file' index='3'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:         <format type='raw'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:         <source file='/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:         <backingStore/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       </backingStore>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <target dev='vda' bus='virtio'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='virtio-disk0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <disk type='file' device='cdrom'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <driver name='qemu' type='raw' cache='none'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config' index='1'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <backingStore/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <target dev='hda' bus='ide'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <readonly/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='ide0-0-0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <controller type='usb' index='0' model='none'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='usb'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <controller type='pci' index='0' model='pci-root'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='pci.0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <controller type='ide' index='0'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='ide'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <interface type='ethernet'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <mac address='fa:16:3e:15:2a:85'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <target dev='tap0bd9217b-5a'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <model type='virtio'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <driver name='qemu'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <mtu size='1372'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='net0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <serial type='pty'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <target type='isa-serial' port='0'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:         <model name='isa-serial'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       </target>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <console type='pty' tty='/dev/pts/5'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <target type='serial' port='0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </console>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <input type='mouse' bus='ps2'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='input0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <input type='keyboard' bus='ps2'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='input1'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <listen type='address' address='0.0.0.0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <audio id='1' type='none'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <model type='virtio' heads='1' primary='yes'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='video0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <stats period='10'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='balloon0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <rng model='virtio'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <backend model='random'>/dev/urandom</backend>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <alias name='rng0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <label>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</label>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <imagelabel>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</imagelabel>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <label>+64055:+993</label>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:     <imagelabel>+64055:+993</imagelabel>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:11.960534 np0000003683 nova-compute[98991]:  {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully detached device tap48de6e51-68 from instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 from the live domain config.
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48de6e51-68, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0ea45b1-eaa7-49fb-8ac6-5dfd5884a75d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:11.969658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.970067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:11.973218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:11.974737 np0000003683 nova-compute[98991]: INFO os_vif [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68')
Jun 26 02:42:11.976118 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-102461132', uuid='9bc60ab4-5d7c-4f30-876b-9b9451b446f2'), owner=OwnerMeta(userid='9bb1094ab9904a39a5c111c76c89104a', username='tempest-TaggedAttachmentsTest-1104328228-project-member', projectid='e41d8ccf228940a5af4ec7724cc6700b', projectname='tempest-TaggedAttachmentsTest-1104328228'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441731.975279) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:42:11</nova:creationTime>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:11.976643 np0000003683 nova-compute[98991]:  {{(pid=98991) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 26 02:42:11.978059 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:11.978365 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:12.000520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:12.000817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:12.001022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:12.001153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:12.001253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:12.003290 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Terminating instance
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.043499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:12.075259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:12.378284 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-deleted-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:12.378558 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Neutron deleted interface 48de6e51-680d-40f0-bad7-16b554f379d9; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:12.379763 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Lazy-loading 'system_metadata' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:12.461328 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:12.462599 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:12.506415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:12.527142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.536059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.549135 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Took 8.88 seconds to spawn the instance on the hypervisor.
Jun 26 02:42:12.549135 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:12.554034 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.557332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.581706 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.582552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.807224 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.817028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:12.843795 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Instance destroyed successfully.
Jun 26 02:42:12.844397 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lazy-loading 'resources' on Instance uuid b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:12.885751 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Lazy-loading 'flavor' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:12.965271 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:42:12.965680 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99977547200001 future=<Future at 0x72e29c4ee2a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:12.965993 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999362432999988 future=<Future at 0x72e29c4ee2a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:12.966093 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999247368999931 future=<Future at 0x72e29c4ee2a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:13.081503 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Took 15.18 seconds to build instance.
Jun 26 02:42:13.125010 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.147646 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.206795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:13.206966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:13.207118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:13.207235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:13.207354 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:13.207785 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7ee2f9b6-879c-46d0-b8ef-396c75e04cb4 req-733dedac-18fb-4102-b1a3-78983a394607 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received unexpected event network-vif-unplugged-48de6e51-680d-40f0-bad7-16b554f379d9 for instance with vm_state active and task_state None.
Jun 26 02:42:13.294311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.305229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.347259 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-273864534',display_name='tempest-ServerActionsTestOtherB-server-273864534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestotherb-server-273864534',id=2,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7vlhtfKiby9zmQ/KHsgs3hbAptYXjNUZ+M3h8EzA9kj1Rp5NP9rFzckpcyft288Cn5FqPW9uAGp2h6Te0vNQRoKsMAMxUzxqg8EPbXsD9gVa0IBZ2Sk5wfuHG038kfsw==',key_name='tempest-keypair-1934480088',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:09Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc72b1dff20e43d1b244280499fc5f65',ramdisk_id='',reservation_id='r-jt2imdun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-315226471',owner_user_name='tempest-ServerActionsTestOtherB-315226471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd70e26fc3b243ffb390cf119334c5e6',uuid=b5ffe1d6-9f45-40d3-bbfc-53dad7150a58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:13.347432 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converting VIF {"id": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "address": "fa:16:3e:45:8c:a8", "network": {"id": "a1b403c3-3c94-4b8f-97d2-ab4914c161de", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1691596142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc72b1dff20e43d1b244280499fc5f65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap809bd0a4-ea", "ovs_interfaceid": "809bd0a4-ea36-4c23-a2fd-5cfa28760410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:13.347988 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:13.348184 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:13.350138 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.350381 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809bd0a4-ea, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:13.351542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.352291 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:13.358082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.358852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.358988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39e844ff-c9ef-43a4-bcf8-16f19ff576ce) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:13.359453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.359897 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:13.365332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.367166 np0000003683 nova-compute[98991]: INFO os_vif [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=809bd0a4-ea36-4c23-a2fd-5cfa28760410,network=Network(a1b403c3-3c94-4b8f-97d2-ab4914c161de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809bd0a4-ea')
Jun 26 02:42:13.369383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:13.369715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:13.369879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:13.370547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:13.370547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:13.370657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:13.387733 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Object Instance<9bc60ab4-5d7c-4f30-876b-9b9451b446f2> lazy-loaded attributes: system_metadata,flavor {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:42:13.388547 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:13.388762 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:13.389321 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:13.391968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface>not found in domain: <domain type='qemu' id='7'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <name>instance-00000007</name>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <uuid>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</uuid>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:42:11</nova:creationTime>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <memory unit='KiB'>196608</memory>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <vcpu placement='static'>1</vcpu>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <resource>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <partition>/machine</partition>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </resource>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <sysinfo type='smbios'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='product'>OpenStack Nova</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='version'>33.1.0</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='serial'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='uuid'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <entry name='family'>Virtual Machine</entry>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <boot dev='hd'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <smbios mode='sysinfo'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <vmcoreinfo state='on'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <cpu mode='custom' match='exact' check='full'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <model fallback='forbid'>Nehalem</model>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <feature policy='require' name='hypervisor'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <clock offset='utc'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <on_poweroff>destroy</on_poweroff>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <on_reboot>restart</on_reboot>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <on_crash>destroy</on_crash>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <disk type='file' device='disk'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk' index='2'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <backingStore type='file' index='3'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:         <format type='raw'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:         <source file='/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:         <backingStore/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       </backingStore>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <target dev='vda' bus='virtio'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='virtio-disk0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <disk type='file' device='cdrom'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <driver name='qemu' type='raw' cache='none'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config' index='1'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <backingStore/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <target dev='hda' bus='ide'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <readonly/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='ide0-0-0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <controller type='usb' index='0' model='none'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='usb'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <controller type='pci' index='0' model='pci-root'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='pci.0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <controller type='ide' index='0'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='ide'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <interface type='ethernet'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <mac address='fa:16:3e:15:2a:85'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <target dev='tap0bd9217b-5a'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <model type='virtio'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <driver name='qemu'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <mtu size='1372'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='net0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <serial type='pty'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <target type='isa-serial' port='0'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:         <model name='isa-serial'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       </target>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <console type='pty' tty='/dev/pts/5'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <target type='serial' port='0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </console>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <input type='mouse' bus='ps2'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='input0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <input type='keyboard' bus='ps2'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='input1'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <listen type='address' address='0.0.0.0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <audio id='1' type='none'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <model type='virtio' heads='1' primary='yes'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='video0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <stats period='10'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='balloon0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <rng model='virtio'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <backend model='random'>/dev/urandom</backend>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <alias name='rng0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <label>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</label>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <imagelabel>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</imagelabel>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <label>+64055:+993</label>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:     <imagelabel>+64055:+993</imagelabel>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:13.393958 np0000003683 nova-compute[98991]:  {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 26 02:42:13.399440 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface> {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.400436 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '30')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:13.401071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '27')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bb:71:fe"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap48de6e51-68"/></interface>not found in domain: <domain type='qemu' id='7'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <name>instance-00000007</name>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <uuid>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</uuid>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:42:11</nova:creationTime>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <memory unit='KiB'>196608</memory>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <vcpu placement='static'>1</vcpu>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <resource>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <partition>/machine</partition>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </resource>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <sysinfo type='smbios'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='product'>OpenStack Nova</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='version'>33.1.0</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='serial'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='uuid'>9bc60ab4-5d7c-4f30-876b-9b9451b446f2</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <entry name='family'>Virtual Machine</entry>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <boot dev='hd'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <smbios mode='sysinfo'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <vmcoreinfo state='on'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <cpu mode='custom' match='exact' check='full'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <model fallback='forbid'>Nehalem</model>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <feature policy='require' name='hypervisor'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <clock offset='utc'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <on_poweroff>destroy</on_poweroff>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <on_reboot>restart</on_reboot>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <on_crash>destroy</on_crash>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <disk type='file' device='disk'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk' index='2'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <backingStore type='file' index='3'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:         <format type='raw'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:         <source file='/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:         <backingStore/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       </backingStore>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <target dev='vda' bus='virtio'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='virtio-disk0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <disk type='file' device='cdrom'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <driver name='qemu' type='raw' cache='none'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <source file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/disk.config' index='1'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <backingStore/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <target dev='hda' bus='ide'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <readonly/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='ide0-0-0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <controller type='usb' index='0' model='none'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='usb'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <controller type='pci' index='0' model='pci-root'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='pci.0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <controller type='ide' index='0'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='ide'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </controller>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <interface type='ethernet'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <mac address='fa:16:3e:15:2a:85'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <target dev='tap0bd9217b-5a'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <model type='virtio'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <driver name='qemu'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <mtu size='1372'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='net0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <serial type='pty'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <target type='isa-serial' port='0'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:         <model name='isa-serial'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       </target>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <console type='pty' tty='/dev/pts/5'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <source path='/dev/pts/5'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <log file='/opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2/console.log' append='off'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <target type='serial' port='0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='serial0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </console>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <input type='mouse' bus='ps2'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='input0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <input type='keyboard' bus='ps2'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='input1'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </input>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <listen type='address' address='0.0.0.0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </graphics>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <audio id='1' type='none'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <model type='virtio' heads='1' primary='yes'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='video0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <stats period='10'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='balloon0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <rng model='virtio'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <backend model='random'>/dev/urandom</backend>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <alias name='rng0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <label>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</label>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <imagelabel>libvirt-9bc60ab4-5d7c-4f30-876b-9b9451b446f2</imagelabel>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <label>+64055:+993</label>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:     <imagelabel>+64055:+993</imagelabel>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:   </seclabel>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:13.401696 np0000003683 nova-compute[98991]:  {{(pid=98991) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 26 02:42:13.406367 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Detaching interface fa:16:3e:bb:71:fe failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap48de6e51-68' not found.
Jun 26 02:42:13.406367 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000003683',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:13.406367 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Converting VIF {"id": "48de6e51-680d-40f0-bad7-16b554f379d9", "address": "fa:16:3e:bb:71:fe", "network": {"id": "6d73c96d-7add-4b92-94ef-f7051403c5ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-681070738", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48de6e51-68", "ovs_interfaceid": "48de6e51-680d-40f0-bad7-16b554f379d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:13.406367 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:13.406367 np0000003683 nova-compute[98991]: DEBUG os_vif [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:13.407289 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:13.407462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48de6e51-68, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:13.407595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:13.411353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc', '28')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:13.413063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3cfba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:13.413858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:13.414207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Flush multipath device 330000000b9eb3d9f {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:13.415503 np0000003683 nova-compute[98991]: INFO os_vif [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:71:fe,bridge_name='br-int',has_traffic_filtering=True,id=48de6e51-680d-40f0-bad7-16b554f379d9,network=Network(6d73c96d-7add-4b92-94ef-f7051403c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48de6e51-68')
Jun 26 02:42:13.416657 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-102461132', uuid='9bc60ab4-5d7c-4f30-876b-9b9451b446f2'), owner=OwnerMeta(userid='9bb1094ab9904a39a5c111c76c89104a', username='tempest-TaggedAttachmentsTest-1104328228-project-member', projectid='e41d8ccf228940a5af4ec7724cc6700b', projectname='tempest-TaggedAttachmentsTest-1104328228'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441733.4161825) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:package version="33.1.0"/>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:name>tempest-device-tagging-server-102461132</nova:name>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:creationTime>2026-06-26 02:42:13</nova:creationTime>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:memory>192</nova:memory>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:disk>1</nova:disk>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:swap>0</nova:swap>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:extraSpecs>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     </nova:extraSpecs>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   </nova:flavor>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:minRam>0</nova:minRam>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:properties>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     </nova:properties>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   </nova:image>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:owner>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:user uuid="9bb1094ab9904a39a5c111c76c89104a">tempest-TaggedAttachmentsTest-1104328228-project-member</nova:user>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:project uuid="e41d8ccf228940a5af4ec7724cc6700b">tempest-TaggedAttachmentsTest-1104328228</nova:project>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   </nova:owner>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   <nova:ports>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     <nova:port uuid="0bd9217b-5ac1-4a72-b992-ba42ce27ad04">
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:     </nova:port>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:   </nova:ports>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]: </nova:instance>
Jun 26 02:42:13.417301 np0000003683 nova-compute[98991]:  {{(pid=98991) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 26 02:42:13.420072 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7df2676d-5ce2-4dd2-a47c-74342d02641f req-fda5b55f-5359-436b-a969-ace30f43d404 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:13.449071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:13.453381 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99968887099999 future=<Future at 0x72e29c46b500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:13.454503 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance destroyed successfully.
Jun 26 02:42:13.497164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:13.544889 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Detaching volume dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:42:13.551786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:13.551919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:13.553228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:13.564215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:13.564412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:13.576354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.586462 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:13.586687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:13.586825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:13.586918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:13.587030 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:13.587144 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:13.587243 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:13.587342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Acquiring lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:13.587451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:13.587595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:13.587710 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] No waiting events found dispatching network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:13.587811 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6818c831-38ce-4922-a2c3-835e01cfbc87 req-e8d4f024-59e3-4cbb-9f4e-092e367670e1 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-unplugged-809bd0a4-ea36-4c23-a2fd-5cfa28760410 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:13.588270 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bec65ac2-6dac-4bac-bed2-9cb6ad0bd2de tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.699s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:13.593293 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attempting to driver detach volume dd66945d-daf7-47e8-8d54-bac6019b1708 from mountpoint /dev/vdb
Jun 26 02:42:13.596465 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found disk vdb by alias ua-dd66945d-daf7-47e8-8d54-bac6019b1708 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:42:13.596670 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Attempting to detach device vdb from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <alias name="ua-dd66945d-daf7-47e8-8d54-bac6019b1708"/>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <serial>dd66945d-daf7-47e8-8d54-bac6019b1708</serial>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:13.596930 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:13.605126 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully detached device vdb from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the persistent domain config.
Jun 26 02:42:13.605897 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:13.606157 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:13.606270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:13.621029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260]
Jun 26 02:42:13.621029 np0000003683 nova-compute[98991]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:13.621029 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.641142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.663533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.695627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260]
Jun 26 02:42:13.695627 np0000003683 nova-compute[98991]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-7cbfed80-b0bc-44d0-bba8-2faab3e1f1cc, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:13.695627 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.720200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.720534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:13.720875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] <== disconnect_volume: return (351ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:13.721054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:13.721351 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.115s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:13.721698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:13.721813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:13.722193 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Deleting instance files /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_del
Jun 26 02:42:13.731372 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Deletion of /opt/stack/data/nova/instances/b5ffe1d6-9f45-40d3-bbfc-53dad7150a58_del complete
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.761329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:13.761630 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:13.761801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '30')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:13.761890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '29')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:13.763169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '30')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:13.765707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3cfba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'): ({'sdo'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:13.765984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Removing multipathed devices sdn, sdo {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:13.766273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flush multipath device 330000000ce24fb25 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:13.806626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:13.849105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:13.849266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquired lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:13.849461 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:13.853637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:13.909900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:13.909900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:13.910409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:13.922443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:13.922562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:13.943264 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:13.981369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260]
Jun 26 02:42:13.981369 np0000003683 nova-compute[98991]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:13.981369 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:14.003726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:14.014952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:14.053647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260]
Jun 26 02:42:14.053647 np0000003683 nova-compute[98991]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:14.053647 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:14.075826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:14.076087 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:14.076270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== disconnect_volume: return (469ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:14.076439 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:14.237876 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Took 1.73 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:14.239418 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:14.239791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:14.239932 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:14.240536 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:14.352279 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:14.371803 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:14.518557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:14.519228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:14.756676 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:14.896876 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [{"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:15.020779 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:15.025836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b16fdd48-4e3b-4250-8fa4-0fba75662b06 req-ab157d9e-b7d9-4a90-80a9-c5bbed5fe633 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Received event network-vif-deleted-809bd0a4-ea36-4c23-a2fd-5cfa28760410 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:15.026041 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-b16fdd48-4e3b-4250-8fa4-0fba75662b06 req-ab157d9e-b7d9-4a90-80a9-c5bbed5fe633 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Neutron deleted interface 809bd0a4-ea36-4c23-a2fd-5cfa28760410; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:15.027471 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b16fdd48-4e3b-4250-8fa4-0fba75662b06 req-ab157d9e-b7d9-4a90-80a9-c5bbed5fe633 service nova] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Detach interface failed, port_id=809bd0a4-ea36-4c23-a2fd-5cfa28760410, reason: Instance b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:15.176226 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance destroyed successfully.
Jun 26 02:42:15.177080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-ServerActionsTestOtherA-server-744880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:22Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:15.177269 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:15.177808 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:15.178038 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:15.181209 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:15.181209 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap447a0c0e-b7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:15.181807 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:15.182734 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:15.183740 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:15.184424 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=898339b0-2759-4e34-a286-8de9b3523688) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:15.185007 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:15.186115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:15.187796 np0000003683 nova-compute[98991]: INFO os_vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7')
Jun 26 02:42:15.188653 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:15.188959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:15.189131 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:15.189424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:15.189745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:15.189859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:15.216297 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:15.216633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:15.217034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:15.217034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:42:15.217193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:15.217193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:42:15.217351 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c2e80>, {}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:15.217495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Disconnecting from: [] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:15.217702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:15.217843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== disconnect_volume: return (29ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:15.217997 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:15.218253 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Deleting instance files /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3_del
Jun 26 02:42:15.219037 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Deletion of /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3_del complete
Jun 26 02:42:15.289383 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:15.289588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:15.289963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:15.289963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:15.289963 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:15.290079 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received unexpected event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with vm_state active and task_state rebuilding.
Jun 26 02:42:15.290171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:15.290282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:15.290393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:15.290502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:15.290968 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:15.291088 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-081c1794-1eae-43cf-acfc-b088d079ea69 req-a6d07c35-4a3e-4449-a806-7ee2fa0c4fb8 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received unexpected event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with vm_state active and task_state rebuilding.
Jun 26 02:42:15.399273 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Releasing lock "refresh_cache-9bc60ab4-5d7c-4f30-876b-9b9451b446f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:15.457429 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:15.585229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:15.585229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:15.587813 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:15.588042 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Claim successful on node np0000003683
Jun 26 02:42:15.685026 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:15.685205 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:15.716326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:15.716567 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:15.902388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2892a849-5d88-46c3-9469-6d2a77672629 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "interface-9bc60ab4-5d7c-4f30-876b-9b9451b446f2-48de6e51-680d-40f0-bad7-16b554f379d9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.868s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:15.959490 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Took 1.72 seconds to deallocate network for instance.
Jun 26 02:42:16.186857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:16.218336 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:16.232002 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Booting with volume dd66945d-daf7-47e8-8d54-bac6019b1708 at /dev/vdb
Jun 26 02:42:16.277881 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:16.287962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:42:16.307147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:16.334912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:42:16.335176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:42:16.342856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:42:16.344536 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe15:2a85', 'fe80::50b1:abff:fe7e:8c1b', 'fe80::fc16:3eff:fe3e:b218', 'fe80::fc16:3eff:fee1:aa1c', 'fe80::cb2:9cff:fe41:6a4f', 'fe80::fc16:3eff:fecd:e366', 'fe80::fc16:3eff:fe11:9deb', 'fe80::fc16:3eff:fe2e:34c3', 'fe80::fc16:3eff:fe10:1fa9', 'fe80::641d:eff:fe76:4352', 'fe80::fc16:3eff:fe8c:eb60', 'fe80::4070:b5ff:fe67:f54a', 'fe80::fc16:3eff:fe8e:e9c4', 'fe80::405:99ff:fea9:f963', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe7b:13b5', 'fe80::68e1:53ff:fe34:301e'] 
Jun 26 02:42:16.344700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:42:16.344821 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:42:16.345115 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:16.345308 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating existing volume attachment record: a1b78384-b79c-4757-a65b-34c537a94524 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:42:16.507827 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:42:16.511188 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:16.761983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:16.788099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:17.027209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:17.148240 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:17.148448 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:17.178903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:17.179059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:17.179281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:17.179402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:17.179542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:17.181657 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Terminating instance
Jun 26 02:42:17.651024 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:17.685259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:17.709842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.714912 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.738866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.744249 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.768353 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.769047 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:17.909747 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:17.909995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:17.910237 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:17.910352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:17.910526 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:17.910999 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0906ff65-b591-4d7d-b2e8-3d425c721eb1 req-6e08caf2-ce48-4355-8be0-5afe102042b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:18.001002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.010369 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.032033 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99964266500001 future=<Future at 0x72e29c4da990 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:18.033466 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Instance destroyed successfully.
Jun 26 02:42:18.034155 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lazy-loading 'resources' on Instance uuid 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:18.157337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.572s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:18.158310 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:18.161340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.396s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:18.164598 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:18.164750 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Claim successful on node np0000003683
Jun 26 02:42:18.455816 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:18.456056 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating image(s)
Jun 26 02:42:18.456487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:18.456756 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:18.457213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:18.457445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "fef4b314883d72943a6f08360c2230e0baf6a871" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:18.457837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "fef4b314883d72943a6f08360c2230e0baf6a871" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:18.542578 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-102461132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-102461132',id=7,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpgRG8gjOTKkpIouj4AULTYoo5/Nqz+QGc3WqRr+qZt6owFrxsHk5nNBXyXNip81p9eQzuZuJwiGJbqadAeo6nayCyn3fjjzUOYB+M0LmSpOs7fhKtZyE6QpWrzuaWb6Q==',key_name='tempest-keypair-1140281180',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e41d8ccf228940a5af4ec7724cc6700b',ramdisk_id='',reservation_id='r-l28he61c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1104328228',owner_user_name='tempest-TaggedAttachmentsTest-1104328228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb1094ab9904a39a5c111c76c89104a',uuid=9bc60ab4-5d7c-4f30-876b-9b9451b446f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:18.542578 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converting VIF {"id": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "address": "fa:16:3e:15:2a:85", "network": {"id": "5c77349f-08c3-40e1-b532-e376453da137", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-649060658-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e41d8ccf228940a5af4ec7724cc6700b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd9217b-5a", "ovs_interfaceid": "0bd9217b-5ac1-4a72-b992-ba42ce27ad04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:18.542578 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:18.542578 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:18.542578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.542949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bd9217b-5a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:18.544063 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.545039 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:18.546046 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.546992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.547168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e972cc78-dab2-4b5e-9863-c25f81d0ed30) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:18.547733 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.548308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:18.548729 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:18.553882 np0000003683 nova-compute[98991]: INFO os_vif [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:2a:85,bridge_name='br-int',has_traffic_filtering=True,id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04,network=Network(5c77349f-08c3-40e1-b532-e376453da137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd9217b-5a')
Jun 26 02:42:18.553882 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Deleting instance files /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2_del
Jun 26 02:42:18.553882 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Deletion of /opt/stack/data/nova/instances/9bc60ab4-5d7c-4f30-876b-9b9451b446f2_del complete
Jun 26 02:42:18.666250 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:18.666687 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:18.667004 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:18.667313 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:18.779919 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dc1fc159eb74ea9848a9474ebe3e07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0e893087347008612ce6860ab8b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:18.787362 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:18.790111 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:18.790513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:18.866014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.part --force-share --output=json" returned: 0 in 0.075s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:18.866544 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] 57a87e28-af94-43db-b1e9-25ce405e5cef was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:42:18.867572 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:42:18.867941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.part /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.016737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.part /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.converted" returned: 0 in 0.148s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.023450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.060594 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:19.061097 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:19.061757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:19.062054 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:19.062566 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:19.102946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871.converted --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.103624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "fef4b314883d72943a6f08360c2230e0baf6a871" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.646s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:19.104114 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:19.107100 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:19.108093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.145871 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:19.167939 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:19.204096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.204301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "fef4b314883d72943a6f08360c2230e0baf6a871" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:19.204776 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "fef4b314883d72943a6f08360c2230e0baf6a871" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:19.205285 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:19.209165 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:19.209701 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.272404 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Successfully created port: b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:19.295209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.295748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871,backing_fmt=raw /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.345756 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871,backing_fmt=raw /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk 1073741824" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.346325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "fef4b314883d72943a6f08360c2230e0baf6a871" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:19.346829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.444811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fef4b314883d72943a6f08360c2230e0baf6a871 --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.445883 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:19.445883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:19.563064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:19.563448 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Cannot resize image /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:19.563997 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:19.564152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Ensure instance console log exists: /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:19.565263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:19.568026 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:19.568230 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:19.570831 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start _get_guest_xml network_info=[{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T02:38:04Z,direct_url=<?>,disk_format='qcow2',id=57a87e28-af94-43db-b1e9-25ce405e5cef,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-26T02:38:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1b78384-b79c-4757-a65b-34c537a94524', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '254192ed-bf2e-4f50-8c84-3be4648db8b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'serial': 'dd66945d-daf7-47e8-8d54-bac6019b1708'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:19.573406 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jun 26 02:42:19.575109 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='57a87e28-af94-43db-b1e9-25ce405e5cef', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-744880919', uuid='254192ed-bf2e-4f50-8c84-3be4648db8b3'), owner=OwnerMeta(userid='bc748533ff1b49ecbfc2f8e239350cea', username='tempest-ServerActionsTestOtherA-1295549616-project-member', projectid='f3004e12281740988b4f5119899f222b', projectname='tempest-ServerActionsTestOtherA-1295549616'), image=ImageMeta(id='57a87e28-af94-43db-b1e9-25ce405e5cef', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441739.5746694) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:19.577351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:19.577351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:19.577351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:19.577579 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:19.578624 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:19.578954 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T02:38:04Z,direct_url=<?>,disk_format='qcow2',id=57a87e28-af94-43db-b1e9-25ce405e5cef,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-26T02:38:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:19.579193 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:19.579291 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:19.579427 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:19.579553 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:19.579643 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:19.579796 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:19.579907 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:19.580013 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:19.580162 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:19.580283 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:19.580428 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'vcpu_model' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:19.684820 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:19.737572 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4d94c2fe-b4c7-4ac0-bb53-eb997ce203d3 req-0f823900-ad57-4df4-9fe0-b46dc9dab1b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-deleted-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:19.738881 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-4d94c2fe-b4c7-4ac0-bb53-eb997ce203d3 req-0f823900-ad57-4df4-9fe0-b46dc9dab1b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Neutron deleted interface 0bd9217b-5ac1-4a72-b992-ba42ce27ad04; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:19.740207 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4d94c2fe-b4c7-4ac0-bb53-eb997ce203d3 req-0f823900-ad57-4df4-9fe0-b46dc9dab1b8 service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Detach interface failed, port_id=0bd9217b-5ac1-4a72-b992-ba42ce27ad04, reason: Instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:19.923458 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Successfully updated port: b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:19.963588 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:19.963989 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:19.982234 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:19.983594 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] Acquiring lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:19.983857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:19.984101 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:19.984399 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] No waiting events found dispatching network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:19.984536 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84de3205-b08d-4c00-b5f6-d8342a4299e7 req-eb11e6b7-708e-4873-a721-99ab79340bdc service nova] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Received event network-vif-unplugged-0bd9217b-5ac1-4a72-b992-ba42ce27ad04 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:19.994872 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-changed-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:19.994872 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Refreshing instance network info cache due to event network-changed-b8cbe7c9-ea84-4621-b36f-eb3e2caae081. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:19.994872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] Acquiring lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:19.994872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] Acquired lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:19.994872 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Refreshing network info cache for port b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:20.094928 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:42:20.095411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:20.095584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:20.095955 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:20.096186 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:42:20.109150 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:20.109696 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:20.110186 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:20.110382 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:20.111544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:20.111724 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:20.124165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:20.124165 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:20.129217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:20.129217 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708] added
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:20.136594 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:20.137049 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:20.137049 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:20.137135 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708] added
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:20.142374 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:20.142697 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:20.142756 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:20.142904 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:20.165585 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:20.425809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:20.467469 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:20.496521 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:20.572420 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:20.670025 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Took 1.61 seconds to deallocate network for instance.
Jun 26 02:42:20.698581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:20.706292 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:20.706292 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Creating image(s)
Jun 26 02:42:20.709497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:20.709497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:20.709497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:20.711367 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:20.724183 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:20.726203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:20.811312 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:20.812210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:20.813128 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:20.813820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:20.814494 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:20.819115 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:20.819578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:20.898690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:20.899468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:20.944344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk 1073741824" returned: 0 in 0.044s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:20.945007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:20.945417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:20.976915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.819s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:20.978406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.189s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:20.979249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:20.988505 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:20.988505 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Claim successful on node np0000003683
Jun 26 02:42:21.031415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:21.031828 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:21.032088 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:21.118364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:21.118817 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Cannot resize image /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:21.119224 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:21.119417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Ensure instance console log exists: /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:21.119774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:21.120003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:21.120157 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:21.137803 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:21.143700 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:21.153795 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:21.163087 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.170307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.175267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.184140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.188644 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.188900 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.194485 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.194711 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:21.236047 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260]
Jun 26 02:42:21.236047 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:21.236047 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.241247 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260]
Jun 26 02:42:21.241247 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:21.241247 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.250006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.256746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.269925 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.270311 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:21.270595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:21.270690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:21.271792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('11', '-', '-', 0) found on session 31 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:21.271941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.277191 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:21.277528 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:21.277809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:21.277809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:21.278770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('12', '-', '-', 0) found on session 32 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:21.278868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:21.286975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 31 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:21.287205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:21.296076 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 32 and hctl ['12', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:21.317714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3639793d-eef9-4471-9449-be611da10b87 req-11e5f8e9-28ee-47d5-844e-ff073fd5c8d3 service nova] Releasing lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:21.317876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquired lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:21.318073 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:21.496542 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:21.499899 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:21.500432 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:21.501151 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:21.515406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:21.602370 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0040e623638942d88ab364c385d035d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56820eb3004485daeddc34b9ff4b4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:21.904469 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:22.006159 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:22.137884 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:22.246608 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Successfully created port: fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:22.297648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 32 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:22.297648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:22.347464 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Updating instance_info_cache with network_info: [{"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:22.512215 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:22.685285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:22.685602 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:22.849384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Releasing lock "refresh_cache-58ffa715-161c-406c-ba94-e14b1a3435e4" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:22.849757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance network_info: |[{"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:22.852432 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Start _get_guest_xml network_info=[{"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:22.857204 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:22.858871 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-155030194', uuid='58ffa715-161c-406c-ba94-e14b1a3435e4'), owner=OwnerMeta(userid='6dc1fc159eb74ea9848a9474ebe3e07a', username='tempest-ServersNegativeTestJSON-731616508-project-member', projectid='a8e0e893087347008612ce6860ab8b9b', projectname='tempest-ServersNegativeTestJSON-731616508'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441742.8583655) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:22.859969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:22.860430 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:22.861771 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:22.862104 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:22.863527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:22.864058 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:22.864391 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:22.864757 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:22.864945 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:22.865197 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:22.865322 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:22.865686 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:22.865854 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:22.866056 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:22.866291 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:22.866491 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:22.882991 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Successfully updated port: fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:22.889374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-155030194',display_name='tempest-ServersNegativeTestJSON-server-155030194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-155030194',id=12,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-btfk03n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:20Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=58ffa715-161c-406c-ba94-e14b1a3435e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:22.889566 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:22.890267 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:22.891105 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lazy-loading 'pci_devices' on Instance uuid 58ffa715-161c-406c-ba94-e14b1a3435e4 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:22.926149 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-changed-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:22.926641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Refreshing instance network info cache due to event network-changed-fce62866-1037-431b-ab1f-f852bca5d951. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:22.926641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] Acquiring lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:22.926641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] Acquired lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:22.926844 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Refreshing network info cache for port fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:23.125808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found WWN 330000000ce24fb25 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:42:23.126161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:23.126453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000ce24fb25', 'path': '/dev/dm-4', 'multipath_id': '330000000ce24fb25'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:23.126646 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce24fb25', 'path': '/dev/dm-4', 'multipath_id': '330000000ce24fb25'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:42:23.188412 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:23.387152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <uuid>58ffa715-161c-406c-ba94-e14b1a3435e4</uuid>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <name>instance-0000000c</name>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServersNegativeTestJSON-server-155030194</nova:name>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:22</nova:creationTime>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:user uuid="6dc1fc159eb74ea9848a9474ebe3e07a">tempest-ServersNegativeTestJSON-731616508-project-member</nova:user>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:project uuid="a8e0e893087347008612ce6860ab8b9b">tempest-ServersNegativeTestJSON-731616508</nova:project>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         <nova:port uuid="b8cbe7c9-ea84-4621-b36f-eb3e2caae081">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="serial">58ffa715-161c-406c-ba94-e14b1a3435e4</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="uuid">58ffa715-161c-406c-ba94-e14b1a3435e4</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.config"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:f2:b5:ec"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <target dev="tapb8cbe7c9-ea"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/console.log" append="off"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:23.393928 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Preparing to wait for external event network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-155030194',display_name='tempest-ServersNegativeTestJSON-server-155030194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-155030194',id=12,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-btfk03n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:20Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=58ffa715-161c-406c-ba94-e14b1a3435e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:23.396069 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:23.396370 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:23.396370 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:23.396809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.397200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.397567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:23.398504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.398776 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '138cf543-81a0-5294-b4bc-1673ae8eab10', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.399804 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.401601 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:23.403451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.404280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8cbe7c9-ea, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.404280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8cbe7c9-ea, col_values=(('qos', UUID('d0c7de77-2fd3-4954-83a8-3e9b10cd3c3e')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.404280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8cbe7c9-ea, col_values=(('external_ids', {'iface-id': 'b8cbe7c9-ea84-4621-b36f-eb3e2caae081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:b5:ec', 'vm-uuid': '58ffa715-161c-406c-ba94-e14b1a3435e4'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.405971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.405971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:23.412661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.413500 np0000003683 nova-compute[98991]: INFO os_vif [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea')
Jun 26 02:42:23.429971 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:23.501346 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:23.523565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:23.523565 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:23.523565 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Creating image(s)
Jun 26 02:42:23.524180 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:23.524564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:23.525255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:23.526067 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:23.532259 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:23.533599 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:23.613286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:23.616662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:23.616662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:23.616662 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:23.618718 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:23.619233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:23.634881 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-ServerActionsTestOtherA-server-744880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:22Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:23.635116 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:23.636219 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <uuid>254192ed-bf2e-4f50-8c84-3be4648db8b3</uuid>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <name>instance-00000009</name>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherA-server-744880919</nova:name>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:19</nova:creationTime>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:image uuid="57a87e28-af94-43db-b1e9-25ce405e5cef">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:user uuid="bc748533ff1b49ecbfc2f8e239350cea">tempest-ServerActionsTestOtherA-1295549616-project-member</nova:user>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:project uuid="f3004e12281740988b4f5119899f222b">tempest-ServerActionsTestOtherA-1295549616</nova:project>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="57a87e28-af94-43db-b1e9-25ce405e5cef"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         <nova:port uuid="447a0c0e-b79d-4be4-9e70-b22de519bb71">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="serial">254192ed-bf2e-4f50-8c84-3be4648db8b3</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="uuid">254192ed-bf2e-4f50-8c84-3be4648db8b3</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <alias name="ua-dd66945d-daf7-47e8-8d54-bac6019b1708"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <serial>dd66945d-daf7-47e8-8d54-bac6019b1708</serial>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c0:70:ce"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <target dev="tap447a0c0e-b7"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/console.log" append="off"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:23.644546 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:23.647227 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-ServerActionsTestOtherA-server-744880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:22Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:23.647368 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:23.647895 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:23.649614 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:23.651838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.652245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.652623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:23.653960 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.654172 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0fc7490-2a0e-594c-b178-2b77a6994a06', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.656394 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:23.662868 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.665497 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.666934 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap447a0c0e-b7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.667379 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap447a0c0e-b7, col_values=(('qos', UUID('461f94ad-5da7-46c4-8bb3-bc85fbec9c29')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.667625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap447a0c0e-b7, col_values=(('external_ids', {'iface-id': '447a0c0e-b79d-4be4-9e70-b22de519bb71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:70:ce', 'vm-uuid': '254192ed-bf2e-4f50-8c84-3be4648db8b3'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:23.680927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.682434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:23.691383 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:23.692299 np0000003683 nova-compute[98991]: INFO os_vif [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7')
Jun 26 02:42:23.696896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.718s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:23.696896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.670s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:23.696896 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:23.714817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:23.715548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:23.738566 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:23.759569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk 1073741824" returned: 0 in 0.044s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:23.760214 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:23.763129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:23.835833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.074s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:23.839502 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:23.839502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:23.916732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Cannot resize image /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Ensure instance console log exists: /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:23.918731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:24.210858 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:24.211391 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:24.212078 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:24.212594 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:24.243741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba14bacf-9655-4ab3-b420-9704895a1092 req-bfa07d19-e16f-42fb-b3be-28859b25956c service nova] Releasing lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:24.245515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquired lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:24.245515 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:24.321587 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0040e623638942d88ab364c385d035d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56820eb3004485daeddc34b9ff4b4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:24.396604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:24.396786 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:24.711866 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:24.828276 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:24.852141 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Successfully created port: e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:24.899374 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:24.930986 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:24.931116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:24.931325 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] No VIF found with MAC fa:16:3e:f2:b5:ec, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:24.931857 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Using config drive
Jun 26 02:42:24.997242 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:25.175075 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updating instance_info_cache with network_info: [{"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:25.216857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:25.222244 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:25.222427 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:25.222615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:25.222784 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:c0:70:ce, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:25.223428 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Using config drive
Jun 26 02:42:25.257420 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:25.257757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:25.257987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:25.258158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:25.258304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:25.261373 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Terminating instance
Jun 26 02:42:25.406103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.710s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:25.407722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.222s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:25.414578 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Successfully updated port: e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:25.438340 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:25.474287 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Deleted allocations for instance b5ffe1d6-9f45-40d3-bbfc-53dad7150a58
Jun 26 02:42:25.478941 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:25.479005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing instance network info cache due to event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:25.479581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] Acquiring lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:25.479715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] Acquired lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:25.479805 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing network info cache for port e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:25.606106 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Creating config drive at /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.config
Jun 26 02:42:25.609279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdcqjvown {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:25.649373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdcqjvown" returned: 0 in 0.040s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:25.677605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Releasing lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:25.678171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance network_info: |[{"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:25.680593 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Start _get_guest_xml network_info=[{"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:25.683457 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:25.685094 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-722297010-1', uuid='09adc163-d707-41cb-8c68-62c7284441f2'), owner=OwnerMeta(userid='0040e623638942d88ab364c385d035d9', username='tempest-TestMultiAttachVolumeSwap-1040529591-project-member', projectid='e56820eb3004485daeddc34b9ff4b4f3', projectname='tempest-TestMultiAttachVolumeSwap-1040529591'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441745.6846392) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:25.688667 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:25.689391 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:25.691463 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:25.691796 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:25.692945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:25.693319 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:25.693469 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:25.693617 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:25.693748 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:25.694131 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:25.694131 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:25.694256 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:25.694398 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:25.694616 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:25.694815 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:25.694880 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:25.709545 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-1',id=13,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=09adc163-d707-41cb-8c68-62c7284441f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:25.709792 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:25.710451 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:25.711104 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'pci_devices' on Instance uuid 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:25.729870 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'ec2_ids' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:25.766053 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:25.818788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.850488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.884428 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.902418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.905321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.910716 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:25.921389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:25.986771 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:26.000988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.037612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:26.038026 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:26.109024 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.117797 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.122570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.152573 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:26.169122 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:26.169562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.169562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.172113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.172292 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:26.172427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8902376c-22a2-4a6a-a79a-016016ef8d07 req-d09fb820-1d50-4e0c-91af-f24820759c94 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:26.177515 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.179159 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.200495 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <uuid>09adc163-d707-41cb-8c68-62c7284441f2</uuid>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <name>instance-0000000d</name>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-722297010-1</nova:name>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:25</nova:creationTime>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:user uuid="0040e623638942d88ab364c385d035d9">tempest-TestMultiAttachVolumeSwap-1040529591-project-member</nova:user>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:project uuid="e56820eb3004485daeddc34b9ff4b4f3">tempest-TestMultiAttachVolumeSwap-1040529591</nova:project>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         <nova:port uuid="fce62866-1037-431b-ab1f-f852bca5d951">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="serial">09adc163-d707-41cb-8c68-62c7284441f2</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="uuid">09adc163-d707-41cb-8c68-62c7284441f2</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.config"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:22:ec:a1"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <target dev="tapfce62866-10"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/console.log" append="off"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:26.214808 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Preparing to wait for external event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-1',id=13,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=09adc163-d707-41cb-8c68-62c7284441f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:26.219051 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:26.220735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.221261 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:26.221261 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:26.222278 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.222397 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6431239a-0b10-5ccc-8ff3-55d2d86e5c63', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:26.223196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.225891 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:26.233078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:26.237049 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:26.237049 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Creating image(s)
Jun 26 02:42:26.237919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.238606 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Object Instance<254192ed-bf2e-4f50-8c84-3be4648db8b3> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:42:26.238836 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'keypairs' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:26.239560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.240815 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.241861 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:26.247514 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:26.255878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:26.269140 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.293107 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:26.302454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.302454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.303160 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.305766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:26.309691 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c021a89d-5e55-4811-b7ba-c23d3375249b req-6e08901f-3548-4a56-87a2-6d31e08fcb1b service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:26.309691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.357952 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.381555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.128s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:26.382066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.383836 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.384197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.384772 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:26.398544 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:26.398544 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:26.423023 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.426293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce62866-10, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:26.432260 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfce62866-10, col_values=(('qos', UUID('726dcb2e-6e8a-47c8-b7c4-963edc96e121')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:26.444470 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:26.444470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.445623 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.446838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfce62866-10, col_values=(('external_ids', {'iface-id': 'fce62866-1037-431b-ab1f-f852bca5d951', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ec:a1', 'vm-uuid': '09adc163-d707-41cb-8c68-62c7284441f2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:26.452752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.453574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:26.453574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21514161-6247-468f-8b8a-e4cf5a5575d1 req-8b98770b-96b9-4c7d-b916-2c111f90d0b3 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:26.458709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:26.489072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-08894b14-c8a2-44a3-8c94-b5ef7a6a3e58 tempest-ServerActionsTestOtherB-315226471 tempest-ServerActionsTestOtherB-315226471-project-member] Lock "b5ffe1d6-9f45-40d3-bbfc-53dad7150a58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.488s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.509392 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.511215 np0000003683 nova-compute[98991]: INFO os_vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10')
Jun 26 02:42:26.517185 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999628578000056 future=<Future at 0x72e29c2b9dc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:26.524957 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Instance destroyed successfully.
Jun 26 02:42:26.529773 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.132s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:26.534626 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lazy-loading 'resources' on Instance uuid 3634e3e6-38af-4398-aaa3-e4cda9ac642e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:26.536493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:26.562806 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:26.585214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.605083 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:26.627406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk 1073741824" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:26.627406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.627406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:26.734039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.108s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:26.735547 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:26.739506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:26.758026 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Object Instance<254192ed-bf2e-4f50-8c84-3be4648db8b3> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:42:26.763411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.772759 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
Jun 26 02:42:26.816785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:26.838231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:26.839800 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Cannot resize image /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:26.839800 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:26.839800 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Ensure instance console log exists: /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:26.839800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:26.840094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:26.840094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:26.988309 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Creating config drive at /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config
Jun 26 02:42:26.992212 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi_dculwv {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:27.051792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi_dculwv" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:27.098635 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.100875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.694s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.104195 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "address": "fa:16:3e:3e:b2:18", "network": {"id": "f3083656-13a5-4307-a955-faa423db92b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-381149962-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1162a0-69", "ovs_interfaceid": "dc1162a0-6944-4512-8fe0-85b1f5b087db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.105931 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.105931 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.109190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.109564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc1162a0-69, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.112251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.117786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c8945688-9f69-4d83-90ac-c817e52e641d req-8ee83220-b8ad-4046-ab60-b6833b615b78 service nova] Releasing lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:27.118725 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquired lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:27.119028 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:27.160397 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.160397 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.160397 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c5c4ac4-19b6-46fa-b59d-11b7aa0bd81a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.162906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.163487 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.196766 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Deleted allocations for instance 9bc60ab4-5d7c-4f30-876b-9b9451b446f2
Jun 26 02:42:27.199802 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.204693 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:b2:18,bridge_name='br-int',has_traffic_filtering=True,id=dc1162a0-6944-4512-8fe0-85b1f5b087db,network=Network(f3083656-13a5-4307-a955-faa423db92b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1162a0-69')
Jun 26 02:42:27.204693 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.204693 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "address": "fa:16:3e:e1:aa:1c", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dc09be-78", "ovs_interfaceid": "17dc09be-78c3-4d85-b3c7-945d44f5b867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.204693 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.204693 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.207054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.207344 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17dc09be-78, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.210018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.211058 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.247790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.249972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.249972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96295b66-f35d-40c1-9bf6-3b174b0ab87d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.250717 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.251365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.287279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.294967 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:aa:1c,bridge_name='br-int',has_traffic_filtering=True,id=17dc09be-78c3-4d85-b3c7-945d44f5b867,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17dc09be-78')
Jun 26 02:42:27.294967 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.294967 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "0526e7f8-4e62-422b-b315-7fb06a018af2", "address": "fa:16:3e:cd:e3:66", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0526e7f8-4e", "ovs_interfaceid": "0526e7f8-4e62-422b-b315-7fb06a018af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.294967 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.294967 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.295318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.295546 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0526e7f8-4e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.296848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.297893 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.330309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.331401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.331630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5533a0f-9d29-4734-a6e5-76eb6353600e) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.332769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.333288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.364298 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.370167 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=0526e7f8-4e62-422b-b315-7fb06a018af2,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0526e7f8-4e')
Jun 26 02:42:27.370167 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.370167 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "address": "fa:16:3e:11:9d:eb", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc318b8cc-5e", "ovs_interfaceid": "c318b8cc-5e75-4e4e-bde6-e66a088b5f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.370167 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.370167 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.371273 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.371571 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc318b8cc-5e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.372735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.374592 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.401441 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.402443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.402610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a530a43a-77ca-4b52-9dea-fa119d6eb7ad) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.403812 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.404332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.434813 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.439700 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9d:eb,bridge_name='br-int',has_traffic_filtering=True,id=c318b8cc-5e75-4e4e-bde6-e66a088b5f53,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc318b8cc-5e')
Jun 26 02:42:27.439700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.439700 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "3c992a23-0d9c-4427-b13f-710d10309ee8", "address": "fa:16:3e:2e:34:c3", "network": {"id": "51438e03-e283-4e2f-b3f3-52a6d67c79c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2066432342", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c992a23-0d", "ovs_interfaceid": "3c992a23-0d9c-4427-b13f-710d10309ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.440234 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.440440 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.442147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.442400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c992a23-0d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.443997 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.445762 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.470069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.470225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.470885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a52d5c4-02a6-413c-b8cf-4280f1125dc1) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.473074 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.474685 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441747.4742656, 58ffa715-161c-406c-ba94-e14b1a3435e4 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:27.474894 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] VM Started (Lifecycle Event)
Jun 26 02:42:27.496108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.498401 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:34:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c992a23-0d9c-4427-b13f-710d10309ee8,network=Network(51438e03-e283-4e2f-b3f3-52a6d67c79c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c992a23-0d')
Jun 26 02:42:27.499781 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.500018 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "1932230d-5ed0-46f3-960f-26380b626a2d", "address": "fa:16:3e:10:1f:a9", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932230d-5e", "ovs_interfaceid": "1932230d-5ed0-46f3-960f-26380b626a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.500714 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.500955 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.502054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.502310 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1932230d-5e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.505387 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.520632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.521788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.522023 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3254d44b-7e8f-43f0-84af-54233c6420e4) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.522838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.523839 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.543524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.553982 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:a9,bridge_name='br-int',has_traffic_filtering=True,id=1932230d-5ed0-46f3-960f-26380b626a2d,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932230d-5e')
Jun 26 02:42:27.555163 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-389598634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-389598634',id=8,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8FNOGzg+6LzuXo3S6oLIlLCYyN/5hBWLVb+312ZGsWV8HtPmu46aBN5MXLDA20UGrjY1haL9cC6D76I8DB10gFttV1IUW/r0h1a8H3arQdI4lEGKP7KpunaUhvgHiHfg==',key_name='tempest-keypair-1275899465',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:39Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07b56acd3834878b91328ea5bf2fb99',ramdisk_id='',reservation_id='r-ha8lrvcd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1043317399',owner_user_name='tempest-TaggedBootDevicesTest-1043317399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca66b021300400abc47122d1ff3006b',uuid=3634e3e6-38af-4398-aaa3-e4cda9ac642e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:27.555163 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converting VIF {"id": "d34d2d35-a59e-42f8-8971-71b744a18144", "address": "fa:16:3e:8c:eb:60", "network": {"id": "b714069b-93df-4604-b895-2b0ecf1b8139", "bridge": "br-int", "label": "tempest-device-tagging-net2-69854402", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a07b56acd3834878b91328ea5bf2fb99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd34d2d35-a5", "ovs_interfaceid": "d34d2d35-a59e-42f8-8971-71b744a18144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:27.555163 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:27.555405 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:27.556915 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.557417 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd34d2d35-a5, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.559687 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.560030 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.581643 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.581886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.582497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.583022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.583224 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.583273 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.583388 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.583541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.583696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.583792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.583902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.584012 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-dc1162a0-6944-4512-8fe0-85b1f5b087db for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.584114 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.584245 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.584359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.584460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.584657 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.584815 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.584930 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.585050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.585168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.585274 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.585372 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.585485 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-17dc09be-78c3-4d85-b3c7-945d44f5b867 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.585599 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.585719 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.585828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.585929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.586029 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.586128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.586229 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.586331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.586437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.586563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.586697 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.586888 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-3c992a23-0d9c-4427-b13f-710d10309ee8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:27.589894 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.591183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.591315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.591436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.591591 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Processing event network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:27.591778 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:27.591886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:27.592011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:27.592108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:27.592216 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] No waiting events found dispatching network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:27.592335 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-eeebd81b-c642-47cd-8f1b-a2b6c9e03498 req-4b8049a9-a76a-4ece-bb10-a2214655d76d service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received unexpected event network-vif-plugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 for instance with vm_state building and task_state spawning.
Jun 26 02:42:27.592878 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.594717 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:27.598565 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:27.600602 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance spawned successfully.
Jun 26 02:42:27.601042 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:27.603234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.610842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.610842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38ff3469-bf4e-4caa-b42e-eeae33d16f4b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:27.611050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.611814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:27.614585 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.620329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.624853 np0000003683 nova-compute[98991]: INFO os_vif [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:eb:60,bridge_name='br-int',has_traffic_filtering=True,id=d34d2d35-a59e-42f8-8971-71b744a18144,network=Network(b714069b-93df-4604-b895-2b0ecf1b8139),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd34d2d35-a5')
Jun 26 02:42:27.626371 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:27.626797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:27.626938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:27.627305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:27.627719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a899dbfa-c6ee-425d-97f1-1d232bf907f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:27.627872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:27.667309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:27.667852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:27.668249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '11')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:27.669450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4', '12')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:27.670499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4d3ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:27.670835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:27.671106 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Flush multipath device 33000000014028578 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:27.693140 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.735210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:27.753136 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:27.766127 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.770941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:27.784900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:27.844453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:27.844656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:27.845941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:27.860362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:27.860587 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:27.878501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:27.931739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.40.100,3260]
Jun 26 02:42:27.931739 np0000003683 nova-compute[98991]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:27.931739 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:27.955228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:27.965898 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00046286699989650515 future=<Future at 0x72e29c4ee2a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:27.966080 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:27.966436 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Emitting event <LifecycleEvent: 1782441732.9652812, b5ffe1d6-9f45-40d3-bbfc-53dad7150a58 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:27.966589 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.48642583399987416 future=<Future at 0x72e29c46b500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:27.966747 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] VM Stopped (Lifecycle Event)
Jun 26 02:42:27.968675 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.48526285000002645 future=<Future at 0x72e29c46b500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:27.968675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:27.974499 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:27.978460 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:27.985087 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:28.021990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.50.100,3260]
Jun 26 02:42:28.021990 np0000003683 nova-compute[98991]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-a899dbfa-c6ee-425d-97f1-1d232bf907f4, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:28.021990 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.042358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.042847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:28.043076 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== disconnect_volume: return (416ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:28.043237 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:28.044853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:28.046161 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:28.046293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No VIF found with MAC fa:16:3e:22:ec:a1, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:28.046730 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:28.049455 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Using config drive
Jun 26 02:42:28.050901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:28.051196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:28.053303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:28.053750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '710d7309-2205-437a-9456-e6d07c808eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:28.053926 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.098132 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:28.098499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:28.098812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '15')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:28.100294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1', '16')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:28.101406 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c47e7a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'): ({'sdm'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:28.101635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Removing multipathed devices sdl, sdm {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:28.101879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Flush multipath device 3300000004161f2ad {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:28.113271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.113491 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.114073 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.114429 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.114862 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.115274 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:28.146624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:28.154501 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating instance_info_cache with network_info: [{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:28.208370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e34f95eb-f750-4b2a-ad40-b232f95c4221 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] Lock "9bc60ab4-5d7c-4f30-876b-9b9451b446f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.029s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.223173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:28.246449 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.246999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.246999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.247203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.247369 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.248207 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-0526e7f8-4e62-422b-b315-7fb06a018af2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:28.248587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.248712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.249299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.249299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.249299 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.249299 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:28.249424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.249645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.250086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.250125 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.250252 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.250459 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24915d2e-5d64-4be1-b473-028e9b845e5c req-a5607945-18b5-46ba-98da-43121455f7a5 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:28.285990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:28.286219 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:28.287350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:28.299237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:28.299540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:28.311045 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.350178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.40.100,3260]
Jun 26 02:42:28.350178 np0000003683 nova-compute[98991]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:28.350178 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.371402 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.384920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.391279 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.391463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.391747 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.391843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.391960 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.392132 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b27478bf-f266-42c5-8958-e1f0873faa46 req-d4cb201b-3ddd-47aa-9677-98c1edad37ab service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-1932230d-5ed0-46f3-960f-26380b626a2d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:28.420539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.50.100,3260]
Jun 26 02:42:28.420539 np0000003683 nova-compute[98991]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-710d7309-2205-437a-9456-e6d07c808eb1, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:28.420539 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.442103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.442422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:28.442609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== disconnect_volume: return (391ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:28.442746 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:28.445496 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:28.445861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:28.445993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:28.446297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:28.446628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed870baa-71ab-41d1-ae86-daa9f4a46c61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:28.446781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:28.453367 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00030636499991487653 future=<Future at 0x72e29c46b500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:28.453528 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:28.453578 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.577540835000036 future=<Future at 0x72e29c4da990 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:28.453676 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.577463229999921 future=<Future at 0x72e29c4da990 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:28.453812 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782441733.4529529, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:28.453890 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Stopped (Lifecycle Event)
Jun 26 02:42:28.469236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7872f874-627e-40eb-a093-1c89bf4c8d84 tempest-TaggedAttachmentsTest-1104328228 tempest-TaggedAttachmentsTest-1104328228-project-member] [instance: b5ffe1d6-9f45-40d3-bbfc-53dad7150a58] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.476438 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61 (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:28.478774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:28.479569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:28.479569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '17')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:28.480427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61', '18')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:28.481373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c0f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:28.481373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:28.481725 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Flush multipath device 330000000246f8e78 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:28.487224 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:42:28.487570 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441748.4872975, 58ffa715-161c-406c-ba94-e14b1a3435e4 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:28.487746 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] VM Paused (Lifecycle Event)
Jun 26 02:42:28.507294 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.507396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Acquiring lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.507672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.507770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.507864 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] No waiting events found dispatching network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.507947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-unplugged-d34d2d35-a59e-42f8-8971-71b744a18144 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:28.508044 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.508165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.508319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.508432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.509936 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.511244 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received unexpected event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with vm_state active and task_state rebuild_spawning.
Jun 26 02:42:28.511405 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:28.511587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.511748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.511864 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:28.511963 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:28.512102 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e5afe21d-457b-478a-961e-aa18f09d93d4 req-40650fc8-6927-4b49-9d99-db204f553d78 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received unexpected event network-vif-plugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with vm_state active and task_state rebuild_spawning.
Jun 26 02:42:28.523757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:28.550443 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:28.550778 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:28.556717 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:28.559008 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance spawned successfully.
Jun 26 02:42:28.561152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:28.571316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:28.622147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:28.622362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:28.623747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:28.626914 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Took 7.93 seconds to spawn the instance on the hypervisor.
Jun 26 02:42:28.627106 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:28.640166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:28.640291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:28.657377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Releasing lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:28.660934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance network_info: |[{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:28.661254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.663714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Start _get_guest_xml network_info=[{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:28.673027 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:28.674403 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-722297010-2', uuid='20a17f81-3782-44c1-a371-4b9c13ff0f6e'), owner=OwnerMeta(userid='0040e623638942d88ab364c385d035d9', username='tempest-TestMultiAttachVolumeSwap-1040529591-project-member', projectid='e56820eb3004485daeddc34b9ff4b4f3', projectname='tempest-TestMultiAttachVolumeSwap-1040529591'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441748.6740127) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:28.675532 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:28.676097 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:28.679500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:28.679500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:28.679500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:28.679763 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:28.679893 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:28.679998 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:28.680149 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:28.680263 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:28.680379 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:28.680568 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:28.680737 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:28.681572 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:28.681572 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:28.681572 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:28.695382 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-2',id=14,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=20a17f81-3782-44c1-a371-4b9c13ff0f6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:28.695746 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:28.696109 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:28.696693 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'pci_devices' on Instance uuid 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:28.702344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.40.100,3260]
Jun 26 02:42:28.702344 np0000003683 nova-compute[98991]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:28.702344 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.719664 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.732746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.747066 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Creating config drive at /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.config
Jun 26 02:42:28.756683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpub0zoksp {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:28.774559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.50.100,3260]
Jun 26 02:42:28.774559 np0000003683 nova-compute[98991]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-ed870baa-71ab-41d1-ae86-daa9f4a46c61, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:28.774559 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.798208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:28.798208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:28.798208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] <== disconnect_volume: return (352ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:28.799327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:28.800087 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Deleting instance files /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e_del
Jun 26 02:42:28.801705 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Deletion of /opt/stack/data/nova/instances/3634e3e6-38af-4398-aaa3-e4cda9ac642e_del complete
Jun 26 02:42:28.815985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpub0zoksp" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:28.870987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:28.871458 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:28.957071 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f2ed41e7-ec54-4da4-a539-1d296cb9d2a5 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:28.990750 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:28.992786 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441748.9924533, 58ffa715-161c-406c-ba94-e14b1a3435e4 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:28.992965 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] VM Resumed (Lifecycle Event)
Jun 26 02:42:29.069671 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.069805 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.070220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.070659 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.071145 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.071592 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:29.140769 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Took 13.61 seconds to build instance.
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <uuid>20a17f81-3782-44c1-a371-4b9c13ff0f6e</uuid>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <name>instance-0000000e</name>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-722297010-2</nova:name>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:28</nova:creationTime>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:user uuid="0040e623638942d88ab364c385d035d9">tempest-TestMultiAttachVolumeSwap-1040529591-project-member</nova:user>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:project uuid="e56820eb3004485daeddc34b9ff4b4f3">tempest-TestMultiAttachVolumeSwap-1040529591</nova:project>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         <nova:port uuid="e5e14439-8594-4c1f-bf6f-bb4222d708cc">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="serial">20a17f81-3782-44c1-a371-4b9c13ff0f6e</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="uuid">20a17f81-3782-44c1-a371-4b9c13ff0f6e</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.config"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:de:76:61"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <target dev="tape5e14439-85"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/console.log" append="off"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:29.200411 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Preparing to wait for external event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-2',id=14,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=20a17f81-3782-44c1-a371-4b9c13ff0f6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:29.202870 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:29.203538 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:29.203911 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:29.204585 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.205022 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:29.205308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:29.206596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.207162 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8a8824d-b022-5899-8bdf-38438d7f3d27', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:29.208460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.211707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:29.217927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.219017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.219268 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5e14439-85, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:29.219904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5e14439-85, col_values=(('qos', UUID('2bab3a41-2644-4a36-b024-16363340a483')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:29.220122 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5e14439-85, col_values=(('external_ids', {'iface-id': 'e5e14439-8594-4c1f-bf6f-bb4222d708cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:76:61', 'vm-uuid': '20a17f81-3782-44c1-a371-4b9c13ff0f6e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:29.221006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.222968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:29.232945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.234446 np0000003683 nova-compute[98991]: INFO os_vif [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85')
Jun 26 02:42:29.315961 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Took 3.55 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:29.316701 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:29.317407 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:29.317557 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:29.317872 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:29.378643 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lazy-loading 'flavor' on Instance uuid 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:29.378643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.414285 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.417536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.495496 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:29.501414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:29.533099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.579673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:29.601246 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:29.643048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-435a966c-df1a-43bb-b64e-82615f72385c tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.124s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:29.801280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.887741 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Ignoring supplied device name: /dev/vdb
Jun 26 02:42:29.973116 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.980436 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:29.996713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:30.002803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:30.005848 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441750.0054255, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:30.007593 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Resumed (Lifecycle Event)
Jun 26 02:42:30.020122 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:30.096165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:30.096425 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:30.096624 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98991) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
Jun 26 02:42:30.390601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:30.508843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:30.510443 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:30.559672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:30.559918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:30.560162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:30.560365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:30.560589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:30.566607 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Terminating instance
Jun 26 02:42:30.578397 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:30.579141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:30.580452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:30.580674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:30.580811 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Processing event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:30.580974 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:30.581110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:30.581262 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:30.581381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:30.581570 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:30.581818 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-21f3a27a-69a8-493d-9c94-2dbf2dafe93e req-23ea044f-7642-43e8-9aae-daa4c6ed4216 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received unexpected event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with vm_state building and task_state spawning.
Jun 26 02:42:30.582691 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:30.585690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:30.589129 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance spawned successfully.
Jun 26 02:42:30.589597 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:30.760902 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:30.761096 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:30.761254 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No VIF found with MAC fa:16:3e:de:76:61, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:30.761816 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Using config drive
Jun 26 02:42:30.971877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.012759 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441751.0123072, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:31.012984 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Started (Lifecycle Event)
Jun 26 02:42:31.072169 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:31.104383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.104383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.104383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.104931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.104931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.105290 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:31.113081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.119116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fbf2f3b3-a9f6-4b6b-b462-af6653243fe5 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.022s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:31.130244 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.267236 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:31.286793 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.303245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.422069 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Instance destroyed successfully.
Jun 26 02:42:31.422624 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lazy-loading 'resources' on Instance uuid 58ffa715-161c-406c-ba94-e14b1a3435e4 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:31.461917 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:31.462806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:31.463001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:31.463187 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:31.463187 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] No waiting events found dispatching network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:31.463301 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-14cc4ce3-a52f-4759-9e7b-72fe9c80c793 req-d157348a-72a5-4c95-9b62-f3dca5e41326 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:31.470669 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Creating config drive at /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.config
Jun 26 02:42:31.476090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyabmvmg6 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:31.491576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:31.493335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:31.496499 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Attaching volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37 to /dev/vdb
Jun 26 02:42:31.519234 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:31.523707 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:31.525833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyabmvmg6" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:31.552743 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:31.564149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:42:31.588147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:31.616261 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.637613 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Took 8.11 seconds to spawn the instance on the hypervisor.
Jun 26 02:42:31.637922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:31.640858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:42:31.641551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:42:31.654508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:42:31.654508 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe8e:e9c4', 'fe80::405:99ff:fea9:f963', 'fe80::fc16:3eff:feef:93bf', 'fe80::1c4b:b4ff:fe3f:b6fa', 'fe80::fc16:3eff:fe7b:13b5', 'fe80::68e1:53ff:fe34:301e', 'fe80::fc16:3eff:fec0:70ce', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1'] 
Jun 26 02:42:31.654508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:42:31.654508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:42:31.654508 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:31.655513 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updating existing volume attachment record: 8bc22833-a6bf-4f5a-90d3-71ade1708360 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:42:31.930795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-155030194',display_name='tempest-ServersNegativeTestJSON-server-155030194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-155030194',id=12,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:28Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-btfk03n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:29Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=58ffa715-161c-406c-ba94-e14b1a3435e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:31.931417 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "address": "fa:16:3e:f2:b5:ec", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cbe7c9-ea", "ovs_interfaceid": "b8cbe7c9-ea84-4621-b36f-eb3e2caae081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:31.931913 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:31.932230 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:31.939493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.940540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8cbe7c9-ea, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:31.945517 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:31.952516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.953892 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.954216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0c7de77-2fd3-4954-83a8-3e9b10cd3c3e) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:31.958457 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.959336 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:31.960999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:31.966021 np0000003683 nova-compute[98991]: INFO os_vif [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b5:ec,bridge_name='br-int',has_traffic_filtering=True,id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cbe7c9-ea')
Jun 26 02:42:31.966377 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Deleting instance files /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4_del
Jun 26 02:42:31.970371 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Deletion of /opt/stack/data/nova/instances/58ffa715-161c-406c-ba94-e14b1a3435e4_del complete
Jun 26 02:42:32.022715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a24f8ccf-2b54-4018-8126-9a0a2671e9c9 req-aaf7034e-9ea4-4e5d-8317-0dbefb75c871 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-deleted-1932230d-5ed0-46f3-960f-26380b626a2d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:32.023417 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-a24f8ccf-2b54-4018-8126-9a0a2671e9c9 req-aaf7034e-9ea4-4e5d-8317-0dbefb75c871 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Neutron deleted interface 1932230d-5ed0-46f3-960f-26380b626a2d; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:32.025225 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a24f8ccf-2b54-4018-8126-9a0a2671e9c9 req-aaf7034e-9ea4-4e5d-8317-0dbefb75c871 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Detach interface failed, port_id=1932230d-5ed0-46f3-960f-26380b626a2d, reason: Instance 3634e3e6-38af-4398-aaa3-e4cda9ac642e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:32.027287 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441752.0268993, 09adc163-d707-41cb-8c68-62c7284441f2 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:32.027485 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] VM Started (Lifecycle Event)
Jun 26 02:42:32.054996 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:32.080723 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:32.153365 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Took 15.46 seconds to build instance.
Jun 26 02:42:32.178493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:32.245176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:42:32.245982 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:32.246194 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:32.246752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:32.247045 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:42:32.263173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:32.264187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:32.265166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:32.265166 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:32.265450 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:32.266151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:32.266464 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:32.266877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:32.288840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:32.288840 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:32.291438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:42:32.291438 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37] added
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:32.307839 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:32.308214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:32.308393 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:32.308657 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37] added
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:42:32.309142 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:32.309334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:42:32.309586 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0445(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:42:32.309776 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:42:32.361662 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c84822c-e664-45c2-9d05-c4328e4d16c1 req-1fb562e9-4026-41d5-8970-2ad5e918f2aa service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-deleted-d34d2d35-a59e-42f8-8971-71b744a18144 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:32.362054 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-5c84822c-e664-45c2-9d05-c4328e4d16c1 req-1fb562e9-4026-41d5-8970-2ad5e918f2aa service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Neutron deleted interface d34d2d35-a59e-42f8-8971-71b744a18144; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:32.364109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c84822c-e664-45c2-9d05-c4328e4d16c1 req-1fb562e9-4026-41d5-8970-2ad5e918f2aa service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Detach interface failed, port_id=d34d2d35-a59e-42f8-8971-71b744a18144, reason: Instance 3634e3e6-38af-4398-aaa3-e4cda9ac642e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:32.478374 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:32.479012 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:32.479313 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:32.480225 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:32.480225 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:32.531219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:32.538673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:32.631848 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:32.656551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.971s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:33.031749 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0006020630000875826 future=<Future at 0x72e29c4da990 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:33.031859 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:33.031975 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.48479314500014 future=<Future at 0x72e29c2b9dc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:33.032057 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.48470088299996 future=<Future at 0x72e29c2b9dc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:33.033769 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Emitting event <LifecycleEvent: 1782441738.031031, 9bc60ab4-5d7c-4f30-876b-9b9451b446f2 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:33.034398 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] VM Stopped (Lifecycle Event)
Jun 26 02:42:33.041606 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441753.0412817, 09adc163-d707-41cb-8c68-62c7284441f2 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:33.041802 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] VM Paused (Lifecycle Event)
Jun 26 02:42:33.053269 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:33.094199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-deleted-dc1162a0-6944-4512-8fe0-85b1f5b087db {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.094454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-deleted-c318b8cc-5e75-4e4e-bde6-e66a088b5f53 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.095704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:33.095948 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.096182 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:33.097562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:33.098865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Processing event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:33.099079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.099573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:33.100516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:33.100878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:33.100878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:33.101238 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Terminating instance
Jun 26 02:42:33.102021 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:33.102281 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-10434ed7-8528-45f3-b3d8-5e7d00bbdd9c req-9d0e953b-daae-4a34-8e06-7f324f93be92 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received unexpected event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with vm_state building and task_state spawning.
Jun 26 02:42:33.112471 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:33.114576 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance spawned successfully.
Jun 26 02:42:33.115254 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:33.309366 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:42:33.310357 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:33.325307 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:42:33.328782 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.346402 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.360590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.366534 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:33.374686 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.374686 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.374686 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.374686 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.374686 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:33.374999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.374999 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.374999 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.374999 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.374999 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:33.402298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.50.100,3260]
Jun 26 02:42:33.402298 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:33.402298 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.415250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.416599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.40.100,3260]
Jun 26 02:42:33.416599 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:33.416599 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.431219 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:33.433842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:33.435508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:33.452742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:33.452937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:33.462129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:42:33.462689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:42:33.462689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:42:33.481596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:42:33.481596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:42:33.522865 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:33.538787 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 9bc60ab4-5d7c-4f30-876b-9b9451b446f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:33.547020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:33.549335 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441753.548695, 09adc163-d707-41cb-8c68-62c7284441f2 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:33.549335 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] VM Resumed (Lifecycle Event)
Jun 26 02:42:33.555458 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Took 4.24 seconds to deallocate network for instance.
Jun 26 02:42:33.566264 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.567584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] Acquiring lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:33.567849 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:33.568032 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:33.568098 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] No waiting events found dispatching network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:33.568820 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-unplugged-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:33.568820 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Received event network-vif-deleted-b8cbe7c9-ea84-4621-b36f-eb3e2caae081 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:33.568820 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Neutron deleted interface b8cbe7c9-ea84-4621-b36f-eb3e2caae081; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:33.569869 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-43531c15-f558-4abb-8dd5-f225c792643f req-a1baa09f-fe58-4428-a8d9-f0a36eec6132 service nova] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Detach interface failed, port_id=b8cbe7c9-ea84-4621-b36f-eb3e2caae081, reason: Instance 58ffa715-161c-406c-ba94-e14b1a3435e4 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:33.605583 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:33.625661 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.625926 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.626309 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.628167 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.628508 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:33.631903 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.632985 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:33.657339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:33.665369 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:33.697151 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:33.953703 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Instance destroyed successfully.
Jun 26 02:42:33.954420 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lazy-loading 'resources' on Instance uuid 0c96a877-c722-4f5d-b621-6d2993d7ad69 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:33.960415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.029012 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Took 1.55 seconds to deallocate network for instance.
Jun 26 02:42:34.054545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:34.056287 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:34.125345 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Received event network-vif-deleted-3c992a23-0d9c-4427-b13f-710d10309ee8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:34.125345 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:34.125345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:34.125771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:34.126011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:34.126578 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:34.127201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e97c7f73-2b61-4c4f-8bda-3e44e47bef84 req-bb572350-df6e-4d9b-ad68-dfa708339626 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:34.146305 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Took 7.91 seconds to spawn the instance on the hypervisor.
Jun 26 02:42:34.146305 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:34.265291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:42:34.458614 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1837666838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionsv293testjson-server-1874603748',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjf0gBUeZlRBhq6W7hSgmKRzqy0lWy4M+k3odC8FuhYSWByxqyU8CiFf1uW5QIWNXBieHVYckUPPGgHcflSCjKA2lfoCdPEGMAz/9EpAsuLGKpfbElBzxHmainkFUIC1Q==',key_name='tempest-keypair-980222912',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:55Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='604c96beaf0646b38621c7b79c2968bd',ramdisk_id='',reservation_id='r-l00chx3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-213768761',owner_user_name='tempest-ServerActionsV293TestJSON-213768761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a64b2d42a9c4039ac9d0a0bb79b951a',uuid=0c96a877-c722-4f5d-b621-6d2993d7ad69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:34.458614 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converting VIF {"id": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "address": "fa:16:3e:ef:93:bf", "network": {"id": "cb6f2e3d-8f60-47e9-9cbd-c84b9679401c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1973996102-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "604c96beaf0646b38621c7b79c2968bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757fd1af-c7", "ovs_interfaceid": "757fd1af-c79d-456e-b641-1382ec7a0b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:34.458614 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:34.458614 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:34.461070 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.461293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap757fd1af-c7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:34.472861 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.474456 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:34.476117 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.476408 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cfe0bfa-6abc-4077-a4c8-70eab7667569) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:34.477212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.477991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:34.479770 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:34.481801 np0000003683 nova-compute[98991]: INFO os_vif [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:93:bf,bridge_name='br-int',has_traffic_filtering=True,id=757fd1af-c79d-456e-b641-1382ec7a0b5a,network=Network(cb6f2e3d-8f60-47e9-9cbd-c84b9679401c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757fd1af-c7')
Jun 26 02:42:34.485769 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:34.485769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:34.485769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:34.535790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:34.536002 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:34.562566 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999679132999972 future=<Future at 0x72e29c4db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:34.562843 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441754.562655, 20a17f81-3782-44c1-a371-4b9c13ff0f6e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:34.563943 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] VM Started (Lifecycle Event)
Jun 26 02:42:34.664792 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Took 17.94 seconds to build instance.
Jun 26 02:42:35.065278 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:35.069341 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:35.095325 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:35.095663 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:35.168042 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.451s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:35.282998 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Found WWN 33000000089c38607 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:42:35.283425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:35.283738 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000089c38607', 'path': '/dev/dm-0', 'multipath_id': '33000000089c38607'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:35.285432 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089c38607', 'path': '/dev/dm-0', 'multipath_id': '33000000089c38607'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:42:35.285432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.799s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:35.285432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58960a13-863b-468a-adc1-8bc8e1ea5fac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:35.285432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:35.287188 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lazy-loading 'flavor' on Instance uuid 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:35.310557 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Took 1.75 seconds to detach 3 volumes for instance.
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:35.316150 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '34')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '24')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac', '23')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c27f560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:35.321804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:35.322903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Flush multipath device 3300000006d49c7c2 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:35.374532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:35.432291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:35.492613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:35.492613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:35.494282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:35.507126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:35.507414 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:35.519925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.551444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260]
Jun 26 02:42:35.551444 np0000003683 nova-compute[98991]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:35.551444 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.572170 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441755.5718718, 20a17f81-3782-44c1-a371-4b9c13ff0f6e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:35.572312 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] VM Paused (Lifecycle Event)
Jun 26 02:42:35.573960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.593054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.598800 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:35.633120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260]
Jun 26 02:42:35.633120 np0000003683 nova-compute[98991]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-58960a13-863b-468a-adc1-8bc8e1ea5fac, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:35.633120 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.651062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:35.651228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:35.651228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] <== disconnect_volume: return (1165ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:35.651343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:35.651621 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deleting instance files /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69_del
Jun 26 02:42:35.652178 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deletion of /opt/stack/data/nova/instances/0c96a877-c722-4f5d-b621-6d2993d7ad69_del complete
Jun 26 02:42:35.791416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Attempting to attach volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:   <alias name="ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37"/>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:   <serial>d320e093-cc3a-4ff5-bf8f-e71cbb783d37</serial>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:35.793638 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:42:35.823328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:36.075994 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:36.088563 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441756.0879889, 20a17f81-3782-44c1-a371-4b9c13ff0f6e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:36.088563 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] VM Resumed (Lifecycle Event)
Jun 26 02:42:36.117754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.582s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:36.120324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.295s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:36.136129 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:36.162913 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Took 2.56 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:36.163452 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:36.163760 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:36.163867 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:36.164061 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:36.202515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:36.202515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Acquiring lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:36.202515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:36.202515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:36.202943 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] No waiting events found dispatching network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:36.202943 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-unplugged-757fd1af-c79d-456e-b641-1382ec7a0b5a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:36.202943 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:36.203141 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing instance network info cache due to event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:36.203141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Acquiring lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:36.203217 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Acquired lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:36.204496 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing network info cache for port e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:36.205533 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Deleted allocations for instance 58ffa715-161c-406c-ba94-e14b1a3435e4
Jun 26 02:42:36.368500 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:36.384207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:36.590714 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:36.593451 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:36.595521 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:36.709879 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:36.744808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:36.745024 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:36.960971 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0253d580-f19e-46de-a5f5-306d73cb8311 req-7df6b9a8-e727-4d88-a140-4554c21bfe6e service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Received event network-vif-deleted-757fd1af-c79d-456e-b641-1382ec7a0b5a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:36.960971 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-0253d580-f19e-46de-a5f5-306d73cb8311 req-7df6b9a8-e727-4d88-a140-4554c21bfe6e service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Neutron deleted interface 757fd1af-c79d-456e-b641-1382ec7a0b5a; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:36.963658 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0253d580-f19e-46de-a5f5-306d73cb8311 req-7df6b9a8-e727-4d88-a140-4554c21bfe6e service nova] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Detach interface failed, port_id=757fd1af-c79d-456e-b641-1382ec7a0b5a, reason: Instance 0c96a877-c722-4f5d-b621-6d2993d7ad69 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:37.098624 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99967290199993 future=<Future at 0x72e29c2eb590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:37.141513 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:37.220068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ec30aa2d-f0a6-4593-8036-86a05b939406 tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "58ffa715-161c-406c-ba94-e14b1a3435e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.660s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:37.251343 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:37.352878 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updated VIF entry in instance network info cache for port e5e14439-8594-4c1f-bf6f-bb4222d708cc. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:42:37.353580 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating instance_info_cache with network_info: [{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:37.392367 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:37.449431 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:37.449573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:37.449690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:37.450099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] No VIF found with MAC fa:16:3e:8e:e9:c4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:37.760681 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.641s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:37.859850 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Deleted allocations for instance 3634e3e6-38af-4398-aaa3-e4cda9ac642e
Jun 26 02:42:37.861988 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bc95f62b-a9fe-4e44-b1c4-3f4feb889b14 req-68a46e4f-4553-494e-bd4c-edcc4e458413 service nova] Releasing lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:37.895936 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Took 1.73 seconds to deallocate network for instance.
Jun 26 02:42:38.187964 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:38.494846 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Took 0.60 seconds to detach 1 volumes for instance.
Jun 26 02:42:38.498001 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Deleting volume: 58960a13-863b-468a-adc1-8bc8e1ea5fac {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:42:38.873116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cd71ec40-8e9d-44e0-b5a7-9ee16dd79162 tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Lock "3634e3e6-38af-4398-aaa3-e4cda9ac642e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.614s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:39.030905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-119f7ba1-9108-402e-85e4-9687624b77ab tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.538s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:39.062153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:39.063827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:39.182086 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event volume-extended-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:39.478595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:39.559914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:39.560232 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:39.684857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Handling volume-extended event for volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37 {{(pid=98991) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
Jun 26 02:42:40.063303 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:40.187807 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Cinder extended volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37; extending it to detect new size
Jun 26 02:42:40.570704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.507s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:40.632351 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Deleted allocations for instance 0c96a877-c722-4f5d-b621-6d2993d7ad69
Jun 26 02:42:40.755067 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] calling os-brick to extend iSCSI Volume {{(pid=98991) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
Jun 26 02:42:40.755626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}), 'kwargs': {}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:40.755626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:40.756184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:40.756549 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}
Jun 26 02:42:40.756717 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Multipath discovery for iSCSI enabled
Jun 26 02:42:40.756956 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0']
Jun 26 02:42:40.756956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0'] {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
Jun 26 02:42:40.779256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0'] {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
Jun 26 02:42:40.779534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Running cmd (subprocess): lsscsi {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:40.817288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] CMD "lsscsi" returned: 0 in 0.037s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:40.817825 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98991) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
Jun 26 02:42:40.817918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
Jun 26 02:42:40.832319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Starting size: 1073741824 {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
Jun 26 02:42:40.860455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] volume size after scsi device rescan 2147483648 {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
Jun 26 02:42:40.860658 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Running cmd (subprocess): lsscsi {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:40.900467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] CMD "lsscsi" returned: 0 in 0.040s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:40.900947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98991) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
Jun 26 02:42:40.901142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
Jun 26 02:42:40.911844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Starting size: 1073741824 {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
Jun 26 02:42:40.940907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] volume size after scsi device rescan 2147483648 {{(pid=98991) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
Jun 26 02:42:40.955064 np0000003683 nova-compute[98991]: INFO os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Find Multipath device file for volume WWN 33000000089c38607
Jun 26 02:42:40.955900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-33000000089c38607 exists yet. {{(pid=98991) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
Jun 26 02:42:40.955900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] /dev/disk/by-id/dm-uuid-mpath-33000000089c38607 has shown up. {{(pid=98991) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
Jun 26 02:42:40.984459 np0000003683 nova-compute[98991]: INFO os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-33000000089c38607) current size 1073741824
Jun 26 02:42:41.026035 np0000003683 nova-compute[98991]: INFO os_brick.initiator.linuxscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-33000000089c38607) new size 2147483648
Jun 26 02:42:41.027767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.271s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:41.027767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] <== extend_volume: return (271ms) 2147483648 {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:41.027767 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Extend iSCSI Volume: new_size=2147483648 {{(pid=98991) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
Jun 26 02:42:41.031184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [req-88c44d13-9b22-4a8a-ab65-f4c8fe3b3914 req-d415587b-f077-495c-8fc5-a46256abcdfd service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Resizing target device /dev/dm-0 to 2147483648 {{(pid=98991) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2935}}
Jun 26 02:42:41.344205 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:41.344852 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 26 02:42:41.517985 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00047404599990841234 future=<Future at 0x72e29c2b9dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:41.517985 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:41.518187 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.044078374000037 future=<Future at 0x72e29c4db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:41.518330 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.043944725000074 future=<Future at 0x72e29c4db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:41.518841 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] Emitting event <LifecycleEvent: 1782441746.516699, 3634e3e6-38af-4398-aaa3-e4cda9ac642e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:41.519045 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] VM Stopped (Lifecycle Event)
Jun 26 02:42:41.591435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:41.644197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dde691c2-35a6-4f40-9e28-2172a792a5e3 tempest-ServerActionsV293TestJSON-213768761 tempest-ServerActionsV293TestJSON-213768761-project-member] Lock "0c96a877-c722-4f5d-b621-6d2993d7ad69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.548s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:41.798017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:41.847495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] There are 0 instances to clean {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 26 02:42:41.848005 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:41.848206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98991) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 26 02:42:41.879451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:41.879924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:41.966998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:41.967343 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:42.022165 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0a450e65-a440-41cc-a6db-3b97006b8f8e tempest-TaggedBootDevicesTest-1043317399 tempest-TaggedBootDevicesTest-1043317399-project-member] [instance: 3634e3e6-38af-4398-aaa3-e4cda9ac642e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:42.352007 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:42.385218 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:42.470211 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Detaching volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37
Jun 26 02:42:42.530610 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Attempting to driver detach volume d320e093-cc3a-4ff5-bf8f-e71cbb783d37 from mountpoint /dev/vdb
Jun 26 02:42:42.536755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Found disk vdb by alias ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Found disk vdb by alias ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Attempting to detach device vdb from instance 57def865-dcb9-4373-9cd5-4437010c97be from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <alias name="ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37"/>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <serial>d320e093-cc3a-4ff5-bf8f-e71cbb783d37</serial>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:42.538538 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Successfully detached device vdb from instance 57def865-dcb9-4373-9cd5-4437010c97be from the persistent domain config.
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] (1/8): Attempting to detach device vdb with device alias ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 from instance 57def865-dcb9-4373-9cd5-4437010c97be from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <alias name="ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37"/>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <serial>d320e093-cc3a-4ff5-bf8f-e71cbb783d37</serial>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:42:42.546900 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:42:42.854621 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:42:42.966166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:42.966438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:42.971176 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:42.971304 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Claim successful on node np0000003683
Jun 26 02:42:43.120224 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441763.119261, 57def865-dcb9-4373-9cd5-4437010c97be => ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:42:43.121358 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 for instance 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:42:43.125624 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Successfully detached device vdb from instance 57def865-dcb9-4373-9cd5-4437010c97be from the live domain config.
Jun 26 02:42:43.126951 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:42:43.127318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:42:43.127498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:42:43.127933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:42:43.128336 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd320e093-cc3a-4ff5-bf8f-e71cbb783d37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:42:43.128528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:42:43.154871 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:43.154871 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:43.154871 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:43.154871 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:43.154871 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:42:43.155175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:43.155175 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:42:43.155175 np0000003683 nova-compute[98991]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:43.155175 np0000003683 nova-compute[98991]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37 (non-flash)
Jun 26 02:42:43.155175 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:42:43.155332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '34')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:42:43.155438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '34')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:43.156524 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37', '33')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:42:43.157526 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e78b7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:42:43.157762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:42:43.158041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Flush multipath device 33000000089c38607 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:42:43.189448 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:43.244453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:42:43.300339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:42:43.300948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:42:43.302281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:42:43.313167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:42:43.313349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:42:43.327444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.357650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.40.100,3260]
Jun 26 02:42:43.357650 np0000003683 nova-compute[98991]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.40.100,3260] successful.
Jun 26 02:42:43.357650 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.374198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.388661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.422027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.50.100,3260]
Jun 26 02:42:43.422027 np0000003683 nova-compute[98991]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-d320e093-cc3a-4ff5-bf8f-e71cbb783d37, portal: 192.168.50.100,3260] successful.
Jun 26 02:42:43.422027 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.437456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:42:43.437865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:42:43.438025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] <== disconnect_volume: return (310ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:42:43.438507 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:42:43.735724 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:43.996395 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lazy-loading 'flavor' on Instance uuid 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:44.039533 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:44.377172 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:44.377644 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:44.496779 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:44.531853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:44.532465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:44.532465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:44.532465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:44.532605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:44.534397 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Terminating instance
Jun 26 02:42:44.881105 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:45.005614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-966d262a-827a-4e37-95f7-a8a6d6a56b8c tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:45.037920 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:45.061254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.066460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.097908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.100125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.126139 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.126855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.259505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:45.259505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:45.259505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:45.259505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:45.259505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:45.261047 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Terminating instance
Jun 26 02:42:45.287519 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:45.287828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:45.288415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:45.290087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:45.290087 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] No waiting events found dispatching network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:45.290087 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6fb65120-2ed9-4c24-b84f-7880309455c7 req-bc67ee3d-3e3e-4391-93ea-c5635cfb11be service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:45.383064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.389189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.422s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:45.389827 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:45.395962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.422922 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99963192500013 future=<Future at 0x72e29c231700 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:45.424939 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Instance destroyed successfully.
Jun 26 02:42:45.425553 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lazy-loading 'resources' on Instance uuid 7dc03f57-e6ba-46ce-8935-335dfd3ce307 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:45.771956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:42:45.804434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.811419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.832192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.834065 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.855188 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:45.856221 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:45.856590 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:45.857146 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:45.857467 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:45.866437 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.869867 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.897958 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:45.898145 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:45.902606 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:45.902606 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:45.929436 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-869322397',display_name='tempest-ServersNegativeTestJSON-server-869322397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serversnegativetestjson-server-869322397',id=11,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e0e893087347008612ce6860ab8b9b',ramdisk_id='',reservation_id='r-7o60mx6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-731616508',owner_user_name='tempest-ServersNegativeTestJSON-731616508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:13Z,user_data=None,user_id='6dc1fc159eb74ea9848a9474ebe3e07a',uuid=7dc03f57-e6ba-46ce-8935-335dfd3ce307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:45.929663 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converting VIF {"id": "e61d109d-7b8a-4b6b-b076-43079b449229", "address": "fa:16:3e:7b:13:b5", "network": {"id": "b1d1dfb6-c98f-4504-add1-dcbc964ceb99", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-43545264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a8e0e893087347008612ce6860ab8b9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape61d109d-7b", "ovs_interfaceid": "e61d109d-7b8a-4b6b-b076-43079b449229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:45.930280 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:45.930572 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:45.933614 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.933926 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape61d109d-7b, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:45.935919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.937444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:45.942339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.944934 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.945651 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6367a99d-ada0-41ab-a80a-f8251ccb9770) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:45.949506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.949506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:45.952604 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:45.960501 np0000003683 nova-compute[98991]: INFO os_vif [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:13:b5,bridge_name='br-int',has_traffic_filtering=True,id=e61d109d-7b8a-4b6b-b076-43079b449229,network=Network(b1d1dfb6-c98f-4504-add1-dcbc964ceb99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape61d109d-7b')
Jun 26 02:42:45.960501 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Deleting instance files /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307_del
Jun 26 02:42:45.960501 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Deletion of /opt/stack/data/nova/instances/7dc03f57-e6ba-46ce-8935-335dfd3ce307_del complete
Jun 26 02:42:46.031004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:46.031702 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:46.031985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:46.032116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:46.032296 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] No waiting events found dispatching network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:46.032425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a06d5dc4-51ce-433d-82f5-896dbbcd643e req-6682f7a2-0f5b-4c9a-b259-bd92ab21c053 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:46.052755 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19a74f26e27346dc9badc9eb4476dfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94375dca8764ff8b335b461730d4cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:46.082888 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.092329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.121752 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999658344999943 future=<Future at 0x72e29c4bcda0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:46.122772 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Instance destroyed successfully.
Jun 26 02:42:46.124008 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lazy-loading 'resources' on Instance uuid 57def865-dcb9-4373-9cd5-4437010c97be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:46.366489 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:46.366887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:46.367047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:46.367208 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:42:46.399295 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:46.464701 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Took 1.43 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:46.464862 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:46.465567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:46.465567 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:46.465842 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:46.593171 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.628007 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:46.631453 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1309385917',display_name='tempest-VolumesExtendAttachedTest-instance-1309385917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesextendattachedtest-instance-1309385917',id=10,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXXVbs9JH4HdnJZTQA/jFcqKB4QJKjEq6USWFRBeWTMqtIauiJt2WlicGd4WFgEYO2wsOlsU/HTZDM7HFfx2oSFSzEOGmlxEudRj8zNIyfAvS1sm0SalP/XxIDBDs9X/A==',key_name='tempest-keypair-881985731',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:41:50Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07e603384bde4a58ba21e66722de0f69',ramdisk_id='',reservation_id='r-d55pfd68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1696909639',owner_user_name='tempest-VolumesExtendAttachedTest-1696909639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf673caf2b0442c9b6e0dbf43bcd6431',uuid=57def865-dcb9-4373-9cd5-4437010c97be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:42:46.631693 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converting VIF {"id": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "address": "fa:16:3e:8e:e9:c4", "network": {"id": "57887155-0007-493a-b3f7-e84197a03615", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1195030402-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e603384bde4a58ba21e66722de0f69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c656c2-04", "ovs_interfaceid": "f0c656c2-04a5-411f-9ace-648e2c7fa5e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:46.632205 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:46.632438 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:42:46.635077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.635361 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0c656c2-04, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:46.636552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.637678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:46.639271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.641130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.641360 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1e7c5ca-05ec-4076-86df-9bea61a816f9) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:46.643119 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:46.644087 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:46.647580 np0000003683 nova-compute[98991]: INFO os_vif [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e9:c4,bridge_name='br-int',has_traffic_filtering=True,id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2,network=Network(57887155-0007-493a-b3f7-e84197a03615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c656c2-04')
Jun 26 02:42:46.649898 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Successfully created port: 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:46.651962 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Deleting instance files /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be_del
Jun 26 02:42:46.655500 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Deletion of /opt/stack/data/nova/instances/57def865-dcb9-4373-9cd5-4437010c97be_del complete
Jun 26 02:42:46.903663 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:47.164668 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:42:47.165707 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:42:47.166109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:42:47.166494 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:42:47.166876 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:47.358785 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:47.367834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:47.390200 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:47.391812 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] Acquiring lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:47.392081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:47.392290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:47.392549 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] No waiting events found dispatching network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:47.393076 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-953b9590-0697-4038-bf81-5e96822fde23 req-b7465aeb-c7a8-4bb8-805b-65a4062cd12e service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-unplugged-e61d109d-7b8a-4b6b-b076-43079b449229 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:47.405703 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Successfully updated port: 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:47.411248 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.430062 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:47.479328 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-changed-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:47.479612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Refreshing instance network info cache due to event network-changed-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:47.479791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] Acquiring lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:47.479910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] Acquired lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:47.480049 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Refreshing network info cache for port 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:47.515792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:47.516362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.623064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:47.623676 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:42:47.626784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.736000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:47.736671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.774686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:47.774686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:47.840810 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:47.843537 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.909342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:47.940297 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Took 1.47 seconds to deallocate network for instance.
Jun 26 02:42:47.942041 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:47.944466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:47.945334 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:47.945561 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Creating image(s)
Jun 26 02:42:47.946343 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.966466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:47.966986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:47.969660 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:47.971198 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:47.978279 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:47.983992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:47.985419 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:48.013945 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7344b82-967e-43da-9e8c-04f764474e13 req-12e7477a-e326-46df-93c6-551fc8b1d803 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-deleted-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:48.014363 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-c7344b82-967e-43da-9e8c-04f764474e13 req-12e7477a-e326-46df-93c6-551fc8b1d803 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Neutron deleted interface f0c656c2-04a5-411f-9ace-648e2c7fa5e2; detaching it from the instance and deleting it from the info cache
Jun 26 02:42:48.020683 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7344b82-967e-43da-9e8c-04f764474e13 req-12e7477a-e326-46df-93c6-551fc8b1d803 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Detach interface failed, port_id=f0c656c2-04a5-411f-9ace-648e2c7fa5e2, reason: Instance 57def865-dcb9-4373-9cd5-4437010c97be could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:42:48.043289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.046702 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '7dc03f57-e6ba-46ce-8935-335dfd3ce307' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '7dc03f57-e6ba-46ce-8935-335dfd3ce307' (instance-0000000b)
Jun 26 02:42:48.048881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.075623 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.076787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.077989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:48.078830 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:48.083608 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:48.084179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.108206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:48.108785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] Acquiring lock "57def865-dcb9-4373-9cd5-4437010c97be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.109080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:48.109232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] Lock "57def865-dcb9-4373-9cd5-4437010c97be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:48.109375 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] No waiting events found dispatching network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:48.109907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Received event network-vif-unplugged-f0c656c2-04a5-411f-9ace-648e2c7fa5e2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:42:48.110155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f31c42ca-5e24-49d0-a352-bf063eab9bd3 req-663a42fe-07ae-45f8-9921-1a722b88f038 service nova] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Received event network-vif-deleted-e61d109d-7b8a-4b6b-b076-43079b449229 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:48.126118 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:48.140165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.140614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.168999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.173269 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.228644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk 1073741824" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.229248 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:48.229710 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.246734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.249895 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '57def865-dcb9-4373-9cd5-4437010c97be' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '57def865-dcb9-4373-9cd5-4437010c97be' (instance-0000000a)
Jun 26 02:42:48.252028 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:48.253929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.281270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:48.295534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.296249 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51353MB free_disk=74.25720977783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:42:48.296463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.296780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:48.349957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.120s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.350374 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:48.350652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:48.395576 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:48.435986 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:48.443615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:48.443615 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Cannot resize image /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:48.444078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:48.444327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Ensure instance console log exists: /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:48.444755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.445522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:48.445522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:48.465503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.854288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:48.900258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2bbbf52-fe1d-4e7b-af34-dc566e50b127 req-066b548b-a6cc-4a30-9b17-fb8d70fc11c6 service nova] Releasing lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:48.900258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquired lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:48.900258 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:48.938908 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Took 1.77 seconds to deallocate network for instance.
Jun 26 02:42:48.968115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:49.382215 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.382318 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.382408 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 57def865-dcb9-4373-9cd5-4437010c97be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.382561 np0000003683 nova-compute[98991]: WARNING nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 7dc03f57-e6ba-46ce-8935-335dfd3ce307 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Jun 26 02:42:49.382729 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 09adc163-d707-41cb-8c68-62c7284441f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.382813 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.382924 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ddf5057b-2a8e-4974-934e-1f89155d50f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:42:49.445292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:49.474473 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:49.563185 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.000911891999976433 future=<Future at 0x72e29c4db2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:49.563317 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:49.563435 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.534572904000015 future=<Future at 0x72e29c2eb590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:49.563546 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.5344554249998055 future=<Future at 0x72e29c2eb590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:49.564290 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Emitting event <LifecycleEvent: 1782441754.5621676, 58ffa715-161c-406c-ba94-e14b1a3435e4 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:49.564534 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] VM Stopped (Lifecycle Event)
Jun 26 02:42:49.647600 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:49.693470 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:49.885179 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 110dbeda-4ed0-4234-863e-7441034d8449 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 26 02:42:49.885657 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 6 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:42:49.885657 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1664MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:42:48 up 29 min,  2 users,  load average: 9.60, 5.04, 2.33\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_f3004e12281740988b4f5119899f222b': '2', 'io_workload': '1', 'num_proj_e56820eb3004485daeddc34b9ff4b4f3': '2', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_a94375dca8764ff8b335b461730d4cdb': '1', 'num_task_deleting': '1', 'num_proj_07e603384bde4a58ba21e66722de0f69': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:42:49.901885 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updating instance_info_cache with network_info: [{"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:50.070009 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 58ffa715-161c-406c-ba94-e14b1a3435e4] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:50.357115 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:50.357430 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:50.406784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Releasing lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:50.407068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance network_info: |[{"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:50.409674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Start _get_guest_xml network_info=[{"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:50.411866 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:50.413447 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1981603150', uuid='ddf5057b-2a8e-4974-934e-1f89155d50f5'), owner=OwnerMeta(userid='19a74f26e27346dc9badc9eb4476dfa1', username='tempest-AttachVolumeNegativeTest-918921231-project-member', projectid='a94375dca8764ff8b335b461730d4cdb', projectname='tempest-AttachVolumeNegativeTest-918921231'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441770.4129517) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:50.419090 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:50.419090 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:50.420688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:50.421434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:50.422414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:50.422414 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:50.422644 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:50.422644 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:50.423556 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:50.423556 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:50.424755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:50.424755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:50.424755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:50.425642 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:50.425642 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:50.425642 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:50.437760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981603150',display_name='tempest-AttachVolumeNegativeTest-server-1981603150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1981603150',id=15,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvWRXS6eTvR+tRz06ncV/wUjaTDuBCmsLQmirBPs7vyrzFiQt65GFEskzftqv5o9ZT94lHre8FVSGxsfFwqWX4kZYxxcQ6+JLHfJUf0B4V/lc1q+EuWa+wXFDkW406z1A==',key_name='tempest-keypair-2044668074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0u0zn63e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=ddf5057b-2a8e-4974-934e-1f89155d50f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:50.437963 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:50.438600 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:50.439665 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'pci_devices' on Instance uuid ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:50.865928 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:50.931712 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <uuid>ddf5057b-2a8e-4974-934e-1f89155d50f5</uuid>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <name>instance-0000000f</name>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1981603150</nova:name>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:50</nova:creationTime>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:user uuid="19a74f26e27346dc9badc9eb4476dfa1">tempest-AttachVolumeNegativeTest-918921231-project-member</nova:user>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:project uuid="a94375dca8764ff8b335b461730d4cdb">tempest-AttachVolumeNegativeTest-918921231</nova:project>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         <nova:port uuid="30fb86c6-1ea8-4dc9-9b71-4422105a3c2b">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="serial">ddf5057b-2a8e-4974-934e-1f89155d50f5</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="uuid">ddf5057b-2a8e-4974-934e-1f89155d50f5</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.config"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c6:5c:b4"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <target dev="tap30fb86c6-1e"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/console.log" append="off"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:50.943792 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Preparing to wait for external event network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981603150',display_name='tempest-AttachVolumeNegativeTest-server-1981603150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1981603150',id=15,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvWRXS6eTvR+tRz06ncV/wUjaTDuBCmsLQmirBPs7vyrzFiQt65GFEskzftqv5o9ZT94lHre8FVSGxsfFwqWX4kZYxxcQ6+JLHfJUf0B4V/lc1q+EuWa+wXFDkW406z1A==',key_name='tempest-keypair-2044668074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0u0zn63e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=ddf5057b-2a8e-4974-934e-1f89155d50f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:50.945957 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:50.946366 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:50.946792 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:50.947889 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.948462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:50.951115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:50.951115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.951115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '390cd45a-1afc-5f5d-9cc5-c0434dd58cfa', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:50.951115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.951869 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:50.956043 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.956277 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fb86c6-1e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:50.956759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30fb86c6-1e, col_values=(('qos', UUID('e29c905a-7ce3-4c4c-b73e-88cd68c693de')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:50.956977 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30fb86c6-1e, col_values=(('external_ids', {'iface-id': '30fb86c6-1ea8-4dc9-9b71-4422105a3c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:5c:b4', 'vm-uuid': 'ddf5057b-2a8e-4974-934e-1f89155d50f5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:50.958007 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.959550 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:50.964014 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:50.965280 np0000003683 nova-compute[98991]: INFO os_vif [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e')
Jun 26 02:42:51.366324 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:42:51.366588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.070s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:51.366940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.901s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:51.367356 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:42:51.368361 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:51.369358 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.514s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:51.373870 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:51.374081 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Claim successful on node np0000003683
Jun 26 02:42:51.435577 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Deleted allocations for instance 7dc03f57-e6ba-46ce-8935-335dfd3ce307
Jun 26 02:42:51.595044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:51.855814 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:51.855814 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:51.855814 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:42:51.855814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:42:51.855990 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.49 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:42:52.098367 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00032182500012822857 future=<Future at 0x72e29c2eb590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:52.098940 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Emitting event <LifecycleEvent: 1782441757.097953, 0c96a877-c722-4f5d-b621-6d2993d7ad69 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:52.098940 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:52.099506 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] VM Stopped (Lifecycle Event)
Jun 26 02:42:52.099506 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.3231457280001 future=<Future at 0x72e29c231700 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:52.099506 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.323033098999986 future=<Future at 0x72e29c231700 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:42:52.445038 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a50fe716-fbd2-45eb-b430-54595eefc6fb tempest-ServersNegativeTestJSON-731616508 tempest-ServersNegativeTestJSON-731616508-project-member] Lock "7dc03f57-e6ba-46ce-8935-335dfd3ce307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.913s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:52.496043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:52.496207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:52.496427 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:c6:5c:b4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:52.499499 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Using config drive
Jun 26 02:42:52.602322 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0c96a877-c722-4f5d-b621-6d2993d7ad69] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:52.795465 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:52.795806 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:53.007490 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:53.141504 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Creating config drive at /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.config
Jun 26 02:42:53.145265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9zwi2qei {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:53.187746 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9zwi2qei" returned: 0 in 0.042s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:53.300189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:53.303792 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:53.679738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:53.709337 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:53.714908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:53.804956 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:53.821977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.453s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:53.822751 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:53.825304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.380s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:54.052470 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:54.082214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:54.088157 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:54.122744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-783f0c84-8093-49b6-8f11-0a77eba5ad04 req-64097b6c-6dc5-4629-b049-b72d0ecd31b1 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:54.123028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783f0c84-8093-49b6-8f11-0a77eba5ad04 req-64097b6c-6dc5-4629-b049-b72d0ecd31b1 service nova] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:54.123579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783f0c84-8093-49b6-8f11-0a77eba5ad04 req-64097b6c-6dc5-4629-b049-b72d0ecd31b1 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:54.123762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783f0c84-8093-49b6-8f11-0a77eba5ad04 req-64097b6c-6dc5-4629-b049-b72d0ecd31b1 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:54.123922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-783f0c84-8093-49b6-8f11-0a77eba5ad04 req-64097b6c-6dc5-4629-b049-b72d0ecd31b1 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Processing event network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:42:54.318538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:54.319098 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:54.337618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:54.337618 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:54.337894 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:54.338321 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:54.411069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:54.427778 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee6c50f6bfbb4d348c72bbd8356447a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb950792b84ac38e258cbabc9785b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:54.636925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:42:54.638558 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441774.638056, ddf5057b-2a8e-4974-934e-1f89155d50f5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:54.639097 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] VM Started (Lifecycle Event)
Jun 26 02:42:54.641201 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:42:54.647940 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance spawned successfully.
Jun 26 02:42:54.650112 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:42:54.730785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:54.826097 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:54.842748 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:55.037435 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:55.039082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:55.040713 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Successfully created port: fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:55.144844 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:55.151381 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:55.158893 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.159109 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.159610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.159975 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.160351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.160800 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:42:55.334513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:55.348724 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:42:55.401803 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Deleted allocations for instance 57def865-dcb9-4373-9cd5-4437010c97be
Jun 26 02:42:55.547551 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:42:55.644589 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Successfully updated port: fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:42:55.655112 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:42:55.655628 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441775.6553938, ddf5057b-2a8e-4974-934e-1f89155d50f5 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:55.655809 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] VM Paused (Lifecycle Event)
Jun 26 02:42:55.668971 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Took 7.73 seconds to spawn the instance on the hypervisor.
Jun 26 02:42:55.669138 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:55.958438 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:56.132215 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:56.132443 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:56.135398 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:42:56.135595 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Claim successful on node np0000003683
Jun 26 02:42:56.148505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:56.148505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:56.148505 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:42:56.159925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:56.165894 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441776.1655197, ddf5057b-2a8e-4974-934e-1f89155d50f5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:42:56.166042 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] VM Resumed (Lifecycle Event)
Jun 26 02:42:56.182590 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Took 13.29 seconds to build instance.
Jun 26 02:42:56.201765 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:56.201966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:56.202140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:56.202275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.202412 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] No waiting events found dispatching network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:42:56.202688 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received unexpected event network-vif-plugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b for instance with vm_state active and task_state None.
Jun 26 02:42:56.203910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-changed-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:56.204047 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing instance network info cache due to event network-changed-fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:56.204185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:56.359355 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:42:56.360257 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:42:56.360469 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Creating image(s)
Jun 26 02:42:56.360927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:56.361077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:56.363745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.365508 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:56.372224 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:56.377350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:56.424267 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7a34539-f47a-4adc-a268-0b0747a51c94 tempest-VolumesExtendAttachedTest-1696909639 tempest-VolumesExtendAttachedTest-1696909639-project-member] Lock "57def865-dcb9-4373-9cd5-4437010c97be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.166s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.466201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:56.469502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:56.469502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:56.469502 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:56.472199 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:42:56.472859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:56.555786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:56.556414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:56.599388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:56.605308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk 1073741824" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:56.605885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.610984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:56.668963 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:42:56.670734 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:42:56.685922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.806s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.698241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:56.699305 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:42:56.699649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:42:56.782949 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:42:56.798368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:42:56.798696 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Cannot resize image /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:42:56.799054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:42:56.799276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Ensure instance console log exists: /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:42:56.799606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:56.799887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:56.800018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:56.987807 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:57.150888 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:57.541796 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:57.566559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:42:57.566792 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:42:57.654240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:57.654574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance network_info: |[{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:42:57.657608 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start _get_guest_xml network_info=[{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:42:57.662017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:57.662295 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing network info cache for port fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:57.675938 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:42:57.677153 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1987187591', uuid='110dbeda-4ed0-4234-863e-7441034d8449'), owner=OwnerMeta(userid='ee6c50f6bfbb4d348c72bbd8356447a9', username='tempest-ServerStableDeviceRescueTest-502021662-project-member', projectid='0aeb950792b84ac38e258cbabc9785b2', projectname='tempest-ServerStableDeviceRescueTest-502021662'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441777.6767461) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:42:57.680535 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:42:57.680905 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:42:57.681831 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:42:57.685123 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:42:57.686147 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:42:57.686509 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:42:57.686692 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:42:57.686797 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:42:57.689170 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:42:57.689437 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:42:57.689635 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:42:57.689983 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:42:57.690130 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:42:57.690250 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:42:57.690365 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:42:57.690495 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:42:57.701691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987187591',display_name='tempest-ServerStableDeviceRescueTest-server-1987187591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverstabledevicerescuetest-server-1987187591',id=16,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBMJg8UMI308yfJ7kxj58PBigfJuGmKE/LcCk0a0HVYoeNNxvQ4y2i2EGyXOLTXdpZWFnK2zxrlWkc5M6vsfhYXZfZC8hz+K4lTbmmyph4/VA0TVytbXE61gUItwip0Q==',key_name='tempest-keypair-1504413044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aeb950792b84ac38e258cbabc9785b2',ramdisk_id='',reservation_id='r-mkw01xlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-502021662',owner_user_name='tempest-ServerStableDeviceRescueTest-502021662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c50f6bfbb4d348c72bbd8356447a9',uuid=110dbeda-4ed0-4234-863e-7441034d8449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:42:57.701866 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converting VIF {"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:57.702493 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:57.703091 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'pci_devices' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:42:58.071707 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:42:58.170308 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <uuid>110dbeda-4ed0-4234-863e-7441034d8449</uuid>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <name>instance-00000010</name>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1987187591</nova:name>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:42:57</nova:creationTime>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:user uuid="ee6c50f6bfbb4d348c72bbd8356447a9">tempest-ServerStableDeviceRescueTest-502021662-project-member</nova:user>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:project uuid="0aeb950792b84ac38e258cbabc9785b2">tempest-ServerStableDeviceRescueTest-502021662</nova:project>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         <nova:port uuid="fbe3af3d-b581-4979-9370-666943905e41">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="serial">110dbeda-4ed0-4234-863e-7441034d8449</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="uuid">110dbeda-4ed0-4234-863e-7441034d8449</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:3c:62:40"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <target dev="tapfbe3af3d-b5"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/console.log" append="off"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:42:58.205940 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Preparing to wait for external event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987187591',display_name='tempest-ServerStableDeviceRescueTest-server-1987187591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverstabledevicerescuetest-server-1987187591',id=16,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBMJg8UMI308yfJ7kxj58PBigfJuGmKE/LcCk0a0HVYoeNNxvQ4y2i2EGyXOLTXdpZWFnK2zxrlWkc5M6vsfhYXZfZC8hz+K4lTbmmyph4/VA0TVytbXE61gUItwip0Q==',key_name='tempest-keypair-1504413044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aeb950792b84ac38e258cbabc9785b2',ramdisk_id='',reservation_id='r-mkw01xlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-502021662',owner_user_name='tempest-ServerStableDeviceRescueTest-502021662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:42:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c50f6bfbb4d348c72bbd8356447a9',uuid=110dbeda-4ed0-4234-863e-7441034d8449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converting VIF {"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:58.209069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:42:58.210020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.210227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd00b8bf-3ac9-5ba4-87ba-1a8f6c5887b4', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:58.211096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.212246 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:58.213151 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.215221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.215411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbe3af3d-b5, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:58.215836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbe3af3d-b5, col_values=(('qos', UUID('a42ba1c2-17c9-48b7-a5a9-d3c786acae79')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:58.216036 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbe3af3d-b5, col_values=(('external_ids', {'iface-id': 'fbe3af3d-b581-4979-9370-666943905e41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:62:40', 'vm-uuid': '110dbeda-4ed0-4234-863e-7441034d8449'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:42:58.216967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.218542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:42:58.224888 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:58.225979 np0000003683 nova-compute[98991]: INFO os_vif [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5')
Jun 26 02:42:58.288489 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-changed-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:42:58.288729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Refreshing instance network info cache due to event network-changed-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:42:58.288952 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] Acquiring lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:42:58.289103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] Acquired lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:42:58.289275 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Refreshing network info cache for port 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:42:58.506123 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:58.578966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.446s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:42:58.579839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:42:58.632911 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updated VIF entry in instance network info cache for port fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:42:58.633208 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:58.794116 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:59.088444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:42:59.088698 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:42:59.088984 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:59.089261 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:59.134950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c4c705b-8a6a-4e98-b813-70f897eedd96 req-5a46552c-8873-4b79-ac02-78f75af7f1b6 service nova] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:59.171792 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b19b282009bd41bd924982574984e524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f149d284f0d24070afe71cccd4c0c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:42:59.185317 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:42:59.353016 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updated VIF entry in instance network info cache for port 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:42:59.353411 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updating instance_info_cache with network_info: [{"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:42:59.408009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:42:59.442322 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:42:59.442611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:42:59.593160 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:42:59.671712 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Successfully created port: a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:42:59.744300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:59.745417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:42:59.745673 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No VIF found with MAC fa:16:3e:3c:62:40, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:42:59.746889 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Using config drive
Jun 26 02:42:59.855958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37ddeab8-d04c-455f-b5c7-d13fb72e8556 req-09621a9a-88de-44c8-be5e-86e7b1de78f3 service nova] Releasing lock "refresh_cache-ddf5057b-2a8e-4974-934e-1f89155d50f5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:42:59.946851 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:43:00.104547 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:43:00.242367 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Successfully updated port: a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:43:00.258037 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:00.362919 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-changed-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:00.363249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Refreshing instance network info cache due to event network-changed-a0a37bc6-1dae-4326-bcc9-fae26e81828a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:00.363454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] Acquiring lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:00.363631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] Acquired lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:00.363778 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Refreshing network info cache for port a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:00.412969 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Creating config drive at /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config
Jun 26 02:43:00.416922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9tov1ixh {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:00.427353 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.004879174000052444 future=<Future at 0x72e29c231700 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:00.427529 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:00.427756 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.6936308829999689 future=<Future at 0x72e29c4bcda0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:00.427875 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.6934986969999954 future=<Future at 0x72e29c4bcda0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:00.429806 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-819c0b29-492e-4607-9d65-1c72face958a None None] Emitting event <LifecycleEvent: 1782441765.4223092, 7dc03f57-e6ba-46ce-8935-335dfd3ce307 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:00.430153 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-819c0b29-492e-4607-9d65-1c72face958a None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] VM Stopped (Lifecycle Event)
Jun 26 02:43:00.461780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9tov1ixh" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:00.610439 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:00.610826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:00.617869 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:00.618040 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Claim successful on node np0000003683
Jun 26 02:43:00.744407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:00.866022 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:00.942040 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-819c0b29-492e-4607-9d65-1c72face958a None None] [instance: 7dc03f57-e6ba-46ce-8935-335dfd3ce307] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:00.942040 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:00.970559 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:00.973178 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.071426 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.121762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:43:01.126361 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.004952572999854965 future=<Future at 0x72e29c4bcda0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:01.129040 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Emitting event <LifecycleEvent: 1782441766.121311, 57def865-dcb9-4373-9cd5-4437010c97be => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:01.129312 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:01.129519 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:43:01.129923 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Creating image(s)
Jun 26 02:43:01.130705 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:01.130939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:01.131580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:01.132185 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:01.133139 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] VM Stopped (Lifecycle Event)
Jun 26 02:43:01.142168 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:01.145020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:01.203994 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:01.246750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:01.248462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:01.252075 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:01.252075 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:01.258737 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:01.260360 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:01.359520 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.367241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:01.382056 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:01.399002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.416575 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.435452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk 1073741824" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:01.436518 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:01.436708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:01.525682 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.537115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:01.537777 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:43:01.538085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:01.600707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:01.635335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:01.635905 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Cannot resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:43:01.636377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:43:01.636642 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Ensure instance console log exists: /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:43:01.637005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:01.637293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:01.637513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:01.640913 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a62045ec-8fcd-48f9-a629-04ce9d410995 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 57def865-dcb9-4373-9cd5-4437010c97be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:01.689443 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Refreshing inventories for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 26 02:43:01.707454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3ea98e4-ec05-45e2-969f-6c81ef7dcfee req-9a1cb09f-1044-4ac1-9f69-644903825f7c service nova] Releasing lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:01.707713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquired lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:01.707921 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:01.740791 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Updating ProviderTree inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 26 02:43:01.741004 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:43:01.803098 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Refreshing aggregate associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, aggregates: None {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 26 02:43:01.861405 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Refreshing trait associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_RISCV64,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_LAN9118 {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 26 02:43:01.958541 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441781.9581962, 110dbeda-4ed0-4234-863e-7441034d8449 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:01.958912 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Started (Lifecycle Event)
Jun 26 02:43:02.295895 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:02.344957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:02.345157 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:02.465304 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:02.467361 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441782.467098, 110dbeda-4ed0-4234-863e-7441034d8449 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:02.467446 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Paused (Lifecycle Event)
Jun 26 02:43:02.506282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:02.506859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:02.507167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:02.507504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:02.507647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:02.507857 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a5acdea4-0399-475f-9222-1c4b943c2f39 req-f444708f-8e40-433b-be04-c34f03b31149 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state building and task_state spawning.
Jun 26 02:43:02.546216 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:02.758509 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:02.848725 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:02.971325 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:02.973394 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:03.230260 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.261261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Releasing lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:03.261582 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance network_info: |[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:43:03.263898 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start _get_guest_xml network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:03.265565 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:03.267024 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-54203554', uuid='ed3b38c4-c012-4f44-8801-8bc21e30c0c5'), owner=OwnerMeta(userid='b19b282009bd41bd924982574984e524', username='tempest-AttachVolumeTestJSON-391502958-project-member', projectid='f149d284f0d24070afe71cccd4c0c744', projectname='tempest-AttachVolumeTestJSON-391502958'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441783.2666407) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:03.269705 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:03.270066 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:03.270779 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:03.270957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:03.271992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:03.272352 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:03.272537 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:03.273017 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:03.273017 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:03.273017 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:03.273017 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:03.273223 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:03.273355 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:03.273507 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:03.273660 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:03.273899 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:03.288907 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:43:03.289123 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:03.289764 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:03.290363 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'pci_devices' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:03.356915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.746s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:03.357324 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:43:03.476962 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <uuid>ed3b38c4-c012-4f44-8801-8bc21e30c0c5</uuid>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <name>instance-00000011</name>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeTestJSON-server-54203554</nova:name>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:03</nova:creationTime>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:user uuid="b19b282009bd41bd924982574984e524">tempest-AttachVolumeTestJSON-391502958-project-member</nova:user>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:project uuid="f149d284f0d24070afe71cccd4c0c744">tempest-AttachVolumeTestJSON-391502958</nova:project>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         <nova:port uuid="a0a37bc6-1dae-4326-bcc9-fae26e81828a">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="serial">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="uuid">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:39:e3:37"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <target dev="tapa0a37bc6-1d"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/console.log" append="off"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Preparing to wait for external event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:03.794238 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.799258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e570000e-ebe4-53e7-a767-d8252633b11d', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:03.801379 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.804503 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:03.805281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.805594 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a37bc6-1d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:03.807088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0a37bc6-1d, col_values=(('qos', UUID('b1f99d4d-0b46-4cbb-8416-95b3137924ab')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:03.807088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0a37bc6-1d, col_values=(('external_ids', {'iface-id': 'a0a37bc6-1dae-4326-bcc9-fae26e81828a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:e3:37', 'vm-uuid': 'ed3b38c4-c012-4f44-8801-8bc21e30c0c5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:03.810406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:03.813694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:03.814614 np0000003683 nova-compute[98991]: INFO os_vif [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:43:03.865005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:43:03.865209 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:43:03.866074 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:03.866299 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:03.951781 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549e56d3a63947e894b5d6d92dd4eafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb8ac3d99734c44bd220c90726dd72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:43:04.368178 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:43:04.394084 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Successfully created port: 053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:43:04.596021 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:04.596193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:04.596355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:04.596489 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:04.596669 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Processing event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:04.596802 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:04.596924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:04.597051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:04.597146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:04.597242 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:04.597343 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e489cffd-d8d2-4ced-bb8b-6271490b1571 req-9acba03a-8b62-4a60-a836-6cbe2d28b2f2 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state building and task_state spawning.
Jun 26 02:43:04.598011 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:04.604598 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441784.604304, 110dbeda-4ed0-4234-863e-7441034d8449 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:04.604806 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Resumed (Lifecycle Event)
Jun 26 02:43:04.606121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:04.608737 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance spawned successfully.
Jun 26 02:43:04.609237 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:04.871559 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:43:05.050631 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Successfully updated port: 053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:43:05.107981 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:05.112538 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-changed-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:05.112724 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Refreshing instance network info cache due to event network-changed-053c7324-4690-4a7c-9a7d-4b70a82e2ee1. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:05.112874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] Acquiring lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:05.113018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] Acquired lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:05.113137 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Refreshing network info cache for port 053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:05.116340 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:05.121065 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.121276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.121826 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.122157 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.122555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.122922 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:05.337971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:05.338145 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:05.338300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:39:e3:37, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:05.338663 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Using config drive
Jun 26 02:43:05.552780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:05.617232 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:05.620532 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:05.629748 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Took 9.27 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:05.629887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:05.702341 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:05.845379 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:05.880914 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:43:05.881861 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:43:05.882128 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Creating image(s)
Jun 26 02:43:05.885147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:05.886124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:05.888063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:05.891708 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:05.895097 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:05.899117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:05.901092 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:05.993951 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:05.994430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:05.994973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:05.995537 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:05.999941 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:06.003151 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Creating config drive at /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config
Jun 26 02:43:06.003560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:06.017586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt21u650z {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:06.064540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt21u650z" returned: 0 in 0.047s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:06.097447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:06.099165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:06.145687 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Took 17.35 seconds to build instance.
Jun 26 02:43:06.152710 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk 1073741824" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:06.157811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:06.158010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:06.237834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:06.238287 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:43:06.238595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:06.320638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:06.321169 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Cannot resize image /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:43:06.321757 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:43:06.322017 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Ensure instance console log exists: /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:43:06.322374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:06.322946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:06.323145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:06.429119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ce4ec732-ec4f-4480-aa3f-ee743e906e37 req-d630e630-fe1a-4541-862f-0c16e044c8b7 service nova] Releasing lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:06.431135 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:06.431328 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:06.532994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.559921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.562988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.603096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.643516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.649199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.875s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:06.747730 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-87cec5ec-35a5-4ebf-afa4-3feacfcd16f6 req-924e44c1-6b0c-4600-9bd1-40e548c7b10a service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:06.748572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-87cec5ec-35a5-4ebf-afa4-3feacfcd16f6 req-924e44c1-6b0c-4600-9bd1-40e548c7b10a service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:06.748572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-87cec5ec-35a5-4ebf-afa4-3feacfcd16f6 req-924e44c1-6b0c-4600-9bd1-40e548c7b10a service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:06.748928 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-87cec5ec-35a5-4ebf-afa4-3feacfcd16f6 req-924e44c1-6b0c-4600-9bd1-40e548c7b10a service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:06.749289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-87cec5ec-35a5-4ebf-afa4-3feacfcd16f6 req-924e44c1-6b0c-4600-9bd1-40e548c7b10a service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Processing event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:06.899263 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.903054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.905862 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:06.929202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:07.021166 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:07.213128 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:07.382689 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Updating instance_info_cache with network_info: [{"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:07.489712 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:07.489929 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441787.4894688, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:07.490087 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Started (Lifecycle Event)
Jun 26 02:43:07.495412 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:07.499315 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance spawned successfully.
Jun 26 02:43:07.501171 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:07.659346 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-changed-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:07.659712 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing instance network info cache due to event network-changed-fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:07.660077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:07.660077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:07.660283 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing network info cache for port fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:07.667981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:07.668209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:07.884690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-cb30fcf0-34d3-4008-b128-9bd46080c204" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:07.885062 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance network_info: |[{"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:43:07.886935 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Start _get_guest_xml network_info=[{"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:07.888759 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:07.889935 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-167003128', uuid='cb30fcf0-34d3-4008-b128-9bd46080c204'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441787.889604) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:07.890769 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:07.891108 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:07.891763 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:07.891919 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:07.892764 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:07.893060 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:07.893258 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:07.893411 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:07.893468 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:07.893602 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:07.893721 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:07.893861 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:07.893958 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:07.894080 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:07.894233 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:07.894356 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:07.904016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167003128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-167003128',id=18,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-aa4v31o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:05Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=cb30fcf0-34d3-4008-b128-9bd46080c204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:43:07.904465 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:07.904838 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:07.905350 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid cb30fcf0-34d3-4008-b128-9bd46080c204 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:07.994531 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:07.995969 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:08.009203 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.009604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.009925 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.010154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.010393 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.010707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:08.162917 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:08.172400 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Detaching volume dd66945d-daf7-47e8-8d54-bac6019b1708
Jun 26 02:43:08.215320 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Attempting to driver detach volume dd66945d-daf7-47e8-8d54-bac6019b1708 from mountpoint /dev/vdb
Jun 26 02:43:08.219735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found disk vdb by alias ua-dd66945d-daf7-47e8-8d54-bac6019b1708 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:08.220796 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found disk vdb by alias ua-dd66945d-daf7-47e8-8d54-bac6019b1708 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:08.220949 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Attempting to detach device vdb from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <alias name="ua-dd66945d-daf7-47e8-8d54-bac6019b1708"/>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <serial>dd66945d-daf7-47e8-8d54-bac6019b1708</serial>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:08.221178 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:08.226003 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully detached device vdb from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the persistent domain config.
Jun 26 02:43:08.226129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] (1/8): Attempting to detach device vdb with device alias ua-dd66945d-daf7-47e8-8d54-bac6019b1708 from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <alias name="ua-dd66945d-daf7-47e8-8d54-bac6019b1708"/>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <serial>dd66945d-daf7-47e8-8d54-bac6019b1708</serial>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:08.226344 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <uuid>cb30fcf0-34d3-4008-b128-9bd46080c204</uuid>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <name>instance-00000012</name>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-167003128</nova:name>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:07</nova:creationTime>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         <nova:port uuid="053c7324-4690-4a7c-9a7d-4b70a82e2ee1">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="serial">cb30fcf0-34d3-4008-b128-9bd46080c204</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="uuid">cb30fcf0-34d3-4008-b128-9bd46080c204</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.config"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8f:93:41"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <target dev="tap053c7324-46"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/console.log" append="off"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Preparing to wait for external event network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:08.408868 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167003128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-167003128',id=18,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-aa4v31o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:05Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=cb30fcf0-34d3-4008-b128-9bd46080c204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.413583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73a04aea-4ce8-5c6e-97ff-e80e3dec3dce', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:08.414304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.414987 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:08.415327 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.418177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.418177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap053c7324-46, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:08.418448 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap053c7324-46, col_values=(('qos', UUID('01cf6dbe-2f19-47d2-bec2-810c06dab28a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:08.418672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap053c7324-46, col_values=(('external_ids', {'iface-id': '053c7324-4690-4a7c-9a7d-4b70a82e2ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:93:41', 'vm-uuid': 'cb30fcf0-34d3-4008-b128-9bd46080c204'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:08.419387 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.420579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:08.424917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:08.426389 np0000003683 nova-compute[98991]: INFO os_vif [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46')
Jun 26 02:43:08.498513 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:08.498855 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441788.498589, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:08.499027 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Paused (Lifecycle Event)
Jun 26 02:43:08.509161 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:08.515255 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Took 7.39 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:08.515556 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:08.674834 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updated VIF entry in instance network info cache for port fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:08.675053 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:08.813337 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:08.813562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:08.813736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:08.813878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:08.814014 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:08.814161 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e7eadc47-114f-4ba1-a98e-f1342b19cddb req-00102822-b007-44bb-9c2a-c0c97cd315de service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state active and task_state None.
Jun 26 02:43:08.918579 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dd66945d-daf7-47e8-8d54-bac6019b1708 for instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:43:09.001640 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:09.005811 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441789.0055091, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:09.005962 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Resumed (Lifecycle Event)
Jun 26 02:43:09.025934 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Took 12.98 seconds to build instance.
Jun 26 02:43:09.176651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f51c0b67-d460-4643-a54c-96d5b3d9ff56 req-6860b79b-ce7d-4ab9-a1d0-f841863bf9db service nova] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:09.508245 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:09.511707 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:09.529933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dc8fd59d-d766-4225-a6c0-76d867d32bd4 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.492s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:09.752099 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-changed-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:09.752249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Refreshing instance network info cache due to event network-changed-a0a37bc6-1dae-4326-bcc9-fae26e81828a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:09.752428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] Acquiring lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:09.752591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] Acquired lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:09.752759 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Refreshing network info cache for port a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:09.947323 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:09.947820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:09.947820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:8f:93:41, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:09.948201 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Using config drive
Jun 26 02:43:10.017135 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441790.0168328, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => ua-dd66945d-daf7-47e8-8d54-bac6019b1708> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:43:10.022651 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully detached device vdb from instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 from the live domain config.
Jun 26 02:43:10.023534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:43:10.023915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:10.024083 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:10.024548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:10.025003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd66945d-daf7-47e8-8d54-bac6019b1708', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:43:10.025183 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:43:10.048370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:43:10.048370 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:43:10.048370 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:10.048655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:43:10.048655 np0000003683 nova-compute[98991]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708 (non-flash)
Jun 26 02:43:10.048655 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:10.048769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:43:10.048932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '31')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:10.049753 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708', '32')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:10.050456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c455bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:43:10.050750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:43:10.051742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flush multipath device 330000000ce24fb25 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:43:10.089935 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:10.142078 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:10.204014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:43:10.204239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:43:10.204984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:43:10.218975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:43:10.219169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:43:10.230573 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.254833 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:10.263772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260]
Jun 26 02:43:10.263772 np0000003683 nova-compute[98991]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:10.263772 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.281240 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.293264 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.325553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260]
Jun 26 02:43:10.325553 np0000003683 nova-compute[98991]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-dd66945d-daf7-47e8-8d54-bac6019b1708, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:10.325553 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.335737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:10.335950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:10.336058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== disconnect_volume: return (312ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:10.336195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:43:10.453143 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:10.611672 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Creating config drive at /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.config
Jun 26 02:43:10.612602 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:10.619853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzo8q2wf2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:10.659442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzo8q2wf2" returned: 0 in 0.042s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:10.775810 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updated VIF entry in instance network info cache for port a0a37bc6-1dae-4326-bcc9-fae26e81828a. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:10.776191 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:10.906084 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'flavor' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:11.152985 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.186141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.188757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.278241 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.285530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5101e12e-149d-4536-8d4b-b3ea5601c404 req-bbf4d4f9-2e4a-4a29-9163-80f0d464eb2f service nova] Releasing lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:11.374799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cd8bd01d-0405-4c5d-9783-7f802e18a0bc req-2ac6600a-a436-4280-a376-39091d822708 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:11.375132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd8bd01d-0405-4c5d-9783-7f802e18a0bc req-2ac6600a-a436-4280-a376-39091d822708 service nova] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:11.375682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd8bd01d-0405-4c5d-9783-7f802e18a0bc req-2ac6600a-a436-4280-a376-39091d822708 service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:11.375936 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd8bd01d-0405-4c5d-9783-7f802e18a0bc req-2ac6600a-a436-4280-a376-39091d822708 service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:11.376408 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cd8bd01d-0405-4c5d-9783-7f802e18a0bc req-2ac6600a-a436-4280-a376-39091d822708 service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Processing event network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:11.517670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.519427 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.520845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.543983 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.606282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:11.913800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6f18e371-b55e-4792-8734-87a125f62dce tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.245s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:12.099871 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:12.102128 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:12.106079 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441792.1055768, cb30fcf0-34d3-4008-b128-9bd46080c204 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:12.106302 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] VM Started (Lifecycle Event)
Jun 26 02:43:12.108189 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance spawned successfully.
Jun 26 02:43:12.108794 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:12.562231 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:12.562618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing instance network info cache due to event network-changed-e5e14439-8594-4c1f-bf6f-bb4222d708cc. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:12.562618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] Acquiring lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:12.562748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] Acquired lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:12.566658 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Refreshing network info cache for port e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:12.608807 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:12.610782 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:12.619632 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:12.619876 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:12.620329 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:12.620664 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:12.621021 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:12.621321 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:13.069285 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:13.069887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:13.070162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:13.070340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:13.070580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:13.072052 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:13.076173 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Terminating instance
Jun 26 02:43:13.116132 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:13.116448 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441793.1162148, cb30fcf0-34d3-4008-b128-9bd46080c204 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:13.116648 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] VM Paused (Lifecycle Event)
Jun 26 02:43:13.126362 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Took 7.25 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:13.126541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:13.188818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:13.189298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:13.421970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.434217 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:13.458841 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:13.459023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:13.459188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:13.459353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:13.459527 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] No waiting events found dispatching network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:13.460111 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f7d80711-6da0-4684-986c-eea1af3addae req-d1bca04b-de32-4bfd-8bd2-f54e4a4cccfa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received unexpected event network-vif-plugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 for instance with vm_state active and task_state None.
Jun 26 02:43:13.584799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:43:13.593877 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updated VIF entry in instance network info cache for port e5e14439-8594-4c1f-bf6f-bb4222d708cc. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:13.594273 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating instance_info_cache with network_info: [{"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:13.618566 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.625587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:13.625587 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.635114 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441793.6300998, cb30fcf0-34d3-4008-b128-9bd46080c204 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:13.635114 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] VM Resumed (Lifecycle Event)
Jun 26 02:43:13.636365 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Took 13.18 seconds to build instance.
Jun 26 02:43:13.652018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.692914 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:13.809866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.817491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.903284 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:13.903284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:13.903284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:13.903903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:13.903903 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:13.903903 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b1540f62-4ce7-4f5b-abaa-012afd2f2b48 req-44b42ce7-c337-4862-88ea-e4312226fb53 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:13.904540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:13.940359 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Instance destroyed successfully.
Jun 26 02:43:13.940359 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'resources' on Instance uuid 254192ed-bf2e-4f50-8c84-3be4648db8b3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:13.942687 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.096504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.097186 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7480c6d8-a853-4f66-99ee-ef2634915d93 req-8eff6183-710e-4144-bfe4-74290aaec632 service nova] Releasing lock "refresh_cache-20a17f81-3782-44c1-a371-4b9c13ff0f6e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:14.102798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.135182 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:14.136806 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:14.138358 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.696s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:14.260231 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.266171 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.443086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-578817223',display_name='tempest-ServerActionsTestOtherA-server-744880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-tempest-common-compute-instance-578817223',id=9,image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwzp4cvq923enVGshss8IeEbpTJe1LiWgXmcqVwmXgrjBbOBH9WkR7ID80DUT5B87dsG12BHHr/jxK+P1Sj8oWNpvhuPBpFVkKIgrn8Um6B5NUeEUO88gxnSBeYz/evPw==',key_name='tempest-keypair-2042106944',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:29Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-4t4ojli0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='57a87e28-af94-43db-b1e9-25ce405e5cef',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=254192ed-bf2e-4f50-8c84-3be4648db8b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:43:14.443276 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "address": "fa:16:3e:c0:70:ce", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap447a0c0e-b7", "ovs_interfaceid": "447a0c0e-b79d-4be4-9e70-b22de519bb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:14.444111 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:14.444396 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:43:14.449294 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.449720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap447a0c0e-b7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:14.451572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.452450 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.454091 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.454239 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=461f94ad-5da7-46c4-8bb3-bc85fbec9c29) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:14.454828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.455323 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:14.456346 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:14.458569 np0000003683 nova-compute[98991]: INFO os_vif [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:70:ce,bridge_name='br-int',has_traffic_filtering=True,id=447a0c0e-b79d-4be4-9e70-b22de519bb71,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap447a0c0e-b7')
Jun 26 02:43:14.459092 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Deleting instance files /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3_del
Jun 26 02:43:14.459719 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Deletion of /opt/stack/data/nova/instances/254192ed-bf2e-4f50-8c84-3be4648db8b3_del complete
Jun 26 02:43:14.639314 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999724807999883 future=<Future at 0x72e29c5db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:14.639759 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999278246999893 future=<Future at 0x72e29c5db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:14.639915 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999076050999975 future=<Future at 0x72e29c5db2c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:14.642576 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-changed-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:14.642656 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Refreshing instance network info cache due to event network-changed-fce62866-1037-431b-ab1f-f852bca5d951. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:14.642829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] Acquiring lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:14.642889 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] Acquired lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:14.642985 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Refreshing network info cache for port fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:14.701933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:14.970251 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:43:14.971006 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:43:14.971216 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:43:14.971283 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:43:14.971515 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:15.100343 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:15.144949 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:15.532847 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:15.543119 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:15.660577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-49fc48e3-06f7-424c-abf6-7ebd39ebccc3 req-82c969dd-066c-4d21-82bd-a50b0609c493 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-deleted-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:15.661116 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-49fc48e3-06f7-424c-abf6-7ebd39ebccc3 req-82c969dd-066c-4d21-82bd-a50b0609c493 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Neutron deleted interface 447a0c0e-b79d-4be4-9e70-b22de519bb71; detaching it from the instance and deleting it from the info cache
Jun 26 02:43:15.663125 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-49fc48e3-06f7-424c-abf6-7ebd39ebccc3 req-82c969dd-066c-4d21-82bd-a50b0609c493 service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Detach interface failed, port_id=447a0c0e-b79d-4be4-9e70-b22de519bb71, reason: Instance 254192ed-bf2e-4f50-8c84-3be4648db8b3 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:43:15.708020 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updated VIF entry in instance network info cache for port fce62866-1037-431b-ab1f-f852bca5d951. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:15.708815 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updating instance_info_cache with network_info: [{"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:15.958675 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:15.958906 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] Acquiring lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:15.959358 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:15.959496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:15.959662 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] No waiting events found dispatching network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:15.960032 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e7304c0-88d8-4f5f-991f-4e1bbc3ab56e req-f69d8450-b05d-4c45-9ab0-57f891e21b2b service nova] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Received event network-vif-unplugged-447a0c0e-b79d-4be4-9e70-b22de519bb71 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:15.967665 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:15.967863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:15.968051 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Attaching volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 to /dev/vdb
Jun 26 02:43:16.018539 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:16.030674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:16.046078 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] instance snapshotting
Jun 26 02:43:16.049292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:16.081958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:16.082312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:16.093778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:16.095755 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] 
Jun 26 02:43:16.095900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:16.096036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:16.096342 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:16.097142 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updating existing volume attachment record: ccb3cb7a-6262-4b05-b916-2b13c5457097 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:16.106494 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:16.181461 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Beginning live snapshot process
Jun 26 02:43:16.212462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2058b8-e6b9-4ccf-bea3-c5592991127e req-b0f4f68b-caad-45cf-b9e7-a906f52c2102 service nova] Releasing lock "refresh_cache-09adc163-d707-41cb-8c68-62c7284441f2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:16.608856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:16.611733 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Took 1.64 seconds to deallocate network for instance.
Jun 26 02:43:16.648401 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:16.648886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:16.649061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:16.649964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:16.650218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:16.662373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:16.663120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:16.663746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:16.663955 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:16.664670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:16.664941 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:16.675975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:16.675975 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:16.681221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:16.681221 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88] added
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:16.688768 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:16.689051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:16.689051 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:16.689212 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88] added
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:16.693348 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:16.693543 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:16.694537 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:16.694537 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:17.118134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:17.118134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:17.506497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:17.506767 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:17.689727 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:17.694157 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:17.699447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:17.717339 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:17.720716 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.733994 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.740070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.747689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:43:17.747689 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:17.747888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:43:17.747888 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:17.748083 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:43:17.748083 np0000003683 nova-compute[98991]: 
Jun 26 02:43:17.754190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:43:17.754190 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:17.754373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:43:17.754373 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:17.754559 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:43:17.754559 np0000003683 nova-compute[98991]: 
Jun 26 02:43:17.779185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.50.100,3260]
Jun 26 02:43:17.779185 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:17.779185 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.791849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.792456 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:17.792947 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:17.806352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.40.100,3260]
Jun 26 02:43:17.806352 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:17.806352 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.808656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.808656 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.808656 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:17.808849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.808849 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.808849 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:17.809593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:17.809887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:17.810826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] HCTL ('7', '-', '-', 0) found on session 35 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:17.811069 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:17.819460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:17.827918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 35 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:17.834783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.834783 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.834783 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:17.835001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.835001 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:17.835001 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:17.835383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:17.835775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:17.836549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] HCTL ('8', '-', '-', 0) found on session 36 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:17.836549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:17.851670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:17.881709 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:17.882583 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:17.887670 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:17.889440 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:17.995736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:17.996188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165.delta 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:18.012024 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:18.037536 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165.delta 1073741824" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:18.038220 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 26 02:43:18.326543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:43:18.329239 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 26 02:43:18.380070 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:43:18.380466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165.delta /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:18.488206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165.delta /opt/stack/data/nova/instances/snapshots/tmpt2p7n7p3/be9c9ed648434226a065a741d4288165" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:18.489433 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Snapshot extracted, beginning image upload
Jun 26 02:43:18.524315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.406s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:18.583542 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Deleted allocations for instance 254192ed-bf2e-4f50-8c84-3be4648db8b3
Jun 26 02:43:18.785394 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:18.786076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:18.828822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 35 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:18.829074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:18.850539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:18.850763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:19.287965 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:43:19.455669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:19.595223 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a5ee0af2-51d2-4515-90f1-d6aef3de28ed tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "254192ed-bf2e-4f50-8c84-3be4648db8b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.525s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:19.665744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:43:19.861136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:19.861136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:19.868140 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:19.868315 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Claim successful on node np0000003683
Jun 26 02:43:20.687452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found WWN 330000000a35c7878 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:20.688011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:20.688335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] <== connect_volume: return (4039ms) {'type': 'block', 'scsi_wwn': '330000000a35c7878', 'path': '/dev/dm-0', 'multipath_id': '330000000a35c7878'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:20.688425 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a35c7878', 'path': '/dev/dm-0', 'multipath_id': '330000000a35c7878'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:20.690629 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:21.008827 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Snapshot image upload complete
Jun 26 02:43:21.009223 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca84efef-4574-433c-b011-315c0e7b350a tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Took 4.96 seconds to snapshot the instance on the hypervisor.
Jun 26 02:43:21.195434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Attempting to attach volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:21.200513 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:43:21.420913 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:21.421158 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:21.614689 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:21.924056 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:22.431637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.571s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:22.431637 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:43:22.849656 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:22.849792 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:22.849892 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:22.849992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No VIF found with MAC fa:16:3e:22:ec:a1, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:22.938940 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:43:22.939122 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:43:22.939470 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:22.940016 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:23.139282 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2a3811e46e84a8282161cbb342b7060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274330e1acd446d9c1a927c3382232d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:43:23.343406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:23.343693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:23.444635 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:43:23.603012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:23.603225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:23.849118 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:43:23.880134 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Successfully created port: 221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:43:23.952105 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:43:24.105128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:43:24.154679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:24.155315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:24.419273 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2a450911-823d-4863-9a62-cb3796b89746 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.451s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:24.422937 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Successfully updated port: 221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:43:24.427929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:24.429147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:24.434193 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:24.434193 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Claim successful on node np0000003683
Jun 26 02:43:24.456898 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:24.480236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-changed-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:24.480667 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Refreshing instance network info cache due to event network-changed-221dfdb4-4266-40d9-9d50-efc8147c1c71. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:24.480953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] Acquiring lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:24.480953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] Acquired lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:24.481078 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Refreshing network info cache for port 221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:24.655396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:24.658940 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:24.925714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:24.967680 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:43:24.968631 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:43:24.968906 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Creating image(s)
Jun 26 02:43:24.969376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:24.969556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:24.970032 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:24.970645 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:24.973161 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:24.974447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:24.987894 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:25.055606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.081s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:25.056163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:25.056976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:25.057347 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:25.061991 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:25.062486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:25.065672 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:25.182448 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.120s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:25.182927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:25.260380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk 1073741824" returned: 0 in 0.077s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:25.262046 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:25.262468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:25.304096 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:25.359812 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:25.360305 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:43:25.360619 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:25.448404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:25.449615 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Cannot resize image /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:43:25.449615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:43:25.449615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Ensure instance console log exists: /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:43:25.449858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:25.449961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:25.450083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:25.675026 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:25.806806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-297c65e2-d118-44aa-87c5-74458343922e req-4de1038d-e92a-41e0-a7a3-227a63c96588 service nova] Releasing lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:25.807341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquired lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:25.807569 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:26.006749 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:26.007011 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:26.374714 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:26.509910 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:26.569246 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:26.615335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:26.712784 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Updating instance_info_cache with network_info: [{"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:26.747743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:26.748383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:26.748383 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Attaching volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 to /dev/vdb
Jun 26 02:43:26.802575 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:26.814896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:26.837887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:26.876168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:26.876550 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:26.883948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:26.885622 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] 
Jun 26 02:43:26.885867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:26.886083 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:26.886453 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:26.886879 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating existing volume attachment record: 4b882094-efc4-46cf-bae8-bef2116e1b9b {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:27.021805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:27.022281 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:43:27.026193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.370s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:27.030157 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:27.030157 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Claim successful on node np0000003683
Jun 26 02:43:27.214980 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Releasing lock "refresh_cache-162c03aa-0004-43b0-ab89-bd1f5b9064d7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:27.215327 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance network_info: |[{"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:43:27.218646 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Start _get_guest_xml network_info=[{"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:27.220723 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:27.224325 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-238946782', uuid='162c03aa-0004-43b0-ab89-bd1f5b9064d7'), owner=OwnerMeta(userid='d2a3811e46e84a8282161cbb342b7060', username='tempest-VolumesNegativeTest-1586592515-project-member', projectid='d274330e1acd446d9c1a927c3382232d', projectname='tempest-VolumesNegativeTest-1586592515'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441807.223875) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:27.225347 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:27.225743 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:27.227927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:27.228131 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:27.229866 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:27.230078 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:27.230215 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:27.230305 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:27.230416 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:27.235577 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:27.235794 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:27.236045 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:27.236177 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:27.236296 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:27.236399 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:27.236550 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:27.251653 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-238946782',display_name='tempest-VolumesNegativeTest-instance-238946782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesnegativetest-instance-238946782',id=19,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274330e1acd446d9c1a927c3382232d',ramdisk_id='',reservation_id='r-cln2l84y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1586592515',owner_user_name='tempest-VolumesNegativeTest-1586592515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:24Z,user_data=None,user_id='d2a3811e46e84a8282161cbb342b7060',uuid=162c03aa-0004-43b0-ab89-bd1f5b9064d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:43:27.251880 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converting VIF {"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:27.252989 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:27.253693 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lazy-loading 'pci_devices' on Instance uuid 162c03aa-0004-43b0-ab89-bd1f5b9064d7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:27.446130 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:27.446679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:27.446891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:27.447304 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:27.447570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:27.459660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:27.460406 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:27.460918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:27.461133 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:27.464367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:27.464367 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:27.473271 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:27.478888 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:27.487149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:27.494019 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:27.499684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.499684 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.499684 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:27.499934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.499934 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.499934 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:27.500172 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:27.500276 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:27.500685 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] HCTL ('8', '0', '0', 0) found on session 36 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:27.500824 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:27.506961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.506961 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.506961 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:27.507153 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.507153 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:27.507153 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:27.507419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:27.507567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:27.507937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] HCTL ('7', '0', '0', 0) found on session 35 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:27.508042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:27.514515 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 36 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:27.514703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:27.517686 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Searching for a device in session 35 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:27.517944 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:27.530249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:43:27.530463 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:43:27.530721 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:27.530980 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:27.606408 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549e56d3a63947e894b5d6d92dd4eafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb8ac3d99734c44bd220c90726dd72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <uuid>162c03aa-0004-43b0-ab89-bd1f5b9064d7</uuid>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <name>instance-00000013</name>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesNegativeTest-instance-238946782</nova:name>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:27</nova:creationTime>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:user uuid="d2a3811e46e84a8282161cbb342b7060">tempest-VolumesNegativeTest-1586592515-project-member</nova:user>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:project uuid="d274330e1acd446d9c1a927c3382232d">tempest-VolumesNegativeTest-1586592515</nova:project>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         <nova:port uuid="221dfdb4-4266-40d9-9d50-efc8147c1c71">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="192.168.233.243" ipVersion="4"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="serial">162c03aa-0004-43b0-ab89-bd1f5b9064d7</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="uuid">162c03aa-0004-43b0-ab89-bd1f5b9064d7</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.config"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:84:2d:07"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <target dev="tap221dfdb4-42"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/console.log" append="off"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:43:27.756820 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Preparing to wait for external event network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-238946782',display_name='tempest-VolumesNegativeTest-instance-238946782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesnegativetest-instance-238946782',id=19,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274330e1acd446d9c1a927c3382232d',ramdisk_id='',reservation_id='r-cln2l84y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1586592515',owner_user_name='tempest-VolumesNegativeTest-1586592515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:24Z,user_data=None,user_id='d2a3811e46e84a8282161cbb342b7060',uuid=162c03aa-0004-43b0-ab89-bd1f5b9064d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converting VIF {"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:43:27.759516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.760182 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:27.760182 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:43:27.761284 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.761556 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe27aed1-9983-528a-a61e-91415c3b88a2', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:27.769172 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.772637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:27.774979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.775240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap221dfdb4-42, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:27.775769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap221dfdb4-42, col_values=(('qos', UUID('25187f51-8e16-4a91-9418-c35901287d6d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:27.775981 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap221dfdb4-42, col_values=(('external_ids', {'iface-id': '221dfdb4-4266-40d9-9d50-efc8147c1c71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2d:07', 'vm-uuid': '162c03aa-0004-43b0-ab89-bd1f5b9064d7'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:27.776980 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.778552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:27.784005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:27.784973 np0000003683 nova-compute[98991]: INFO os_vif [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42')
Jun 26 02:43:28.030293 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:43:28.060139 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Successfully created port: 911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:43:28.463879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:43:28.533612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:43:28.583497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:28.583497 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:28.628051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Successfully updated port: 911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:43:28.677703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-changed-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:28.677703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Refreshing instance network info cache due to event network-changed-911b3e19-9e80-4d7e-8456-b91f56dc972b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:28.677703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] Acquiring lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:28.677703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] Acquired lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:28.677909 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Refreshing network info cache for port 911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:28.779633 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:29.037701 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Booting with blank volume at /dev/vda
Jun 26 02:43:29.086023 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:29.131067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:29.179514 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:29.241552 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:29.304531 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:29.304691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:29.304822 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] No VIF found with MAC fa:16:3e:84:2d:07, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:29.305385 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Using config drive
Jun 26 02:43:29.480320 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found WWN 330000000a35c7878 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:29.481293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:29.481293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '330000000a35c7878', 'path': '/dev/dm-0', 'multipath_id': '330000000a35c7878'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:29.481293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a35c7878', 'path': '/dev/dm-0', 'multipath_id': '330000000a35c7878'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:29.484458 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:29.498564 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:29.594243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.569s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:29.594522 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:43:29.639543 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004105940001863928 future=<Future at 0x72e29c5db2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:29.640072 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Emitting event <LifecycleEvent: 1782441794.6389227, 254192ed-bf2e-4f50-8c84-3be4648db8b3 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:29.640285 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:29.640436 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] VM Stopped (Lifecycle Event)
Jun 26 02:43:29.812653 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:29.938356 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Creating config drive at /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.config
Jun 26 02:43:29.947644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5u_8f6ce {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:29.990160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Attempting to attach volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:29.991798 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:43:29.992692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5u_8f6ce" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:29.998526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dc6caa8d-1db8-4fb7-8804-abbd55794e8b req-5e105b43-23df-46d6-a327-76abc01c2616 service nova] Releasing lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:30.000240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:30.000240 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:30.102212 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:43:30.102847 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:43:30.103696 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:30.104329 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:30.143580 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 254192ed-bf2e-4f50-8c84-3be4648db8b3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:30.184176 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc748533ff1b49ecbfc2f8e239350cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3004e12281740988b4f5119899f222b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:43:30.345567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.385748 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.584338 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:30.603705 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:43:30.613144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.694150 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.697355 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Successfully created port: 3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:43:30.699920 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.741803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.805049 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:30.888287 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e410fe69-e463-441c-87f7-f7a2464a2b68 req-4a7311c3-6293-4f34-bc80-17920f017886 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:30.889146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e410fe69-e463-441c-87f7-f7a2464a2b68 req-4a7311c3-6293-4f34-bc80-17920f017886 service nova] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:30.889324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e410fe69-e463-441c-87f7-f7a2464a2b68 req-4a7311c3-6293-4f34-bc80-17920f017886 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:30.889616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e410fe69-e463-441c-87f7-f7a2464a2b68 req-4a7311c3-6293-4f34-bc80-17920f017886 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:30.889773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e410fe69-e463-441c-87f7-f7a2464a2b68 req-4a7311c3-6293-4f34-bc80-17920f017886 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Processing event network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:30.982465 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.983719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:30.987576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:31.009887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:31.021454 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating instance_info_cache with network_info: [{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:31.112040 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:43:31.342037 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Successfully updated port: 3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:43:31.402977 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-changed-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:31.403130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Refreshing instance network info cache due to event network-changed-3a3cdf50-439e-4f79-825f-6ff30b237db8. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:31.403242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:31.403321 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:31.403433 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Refreshing network info cache for port 3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:31.490345 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:31.490980 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441811.490614, 162c03aa-0004-43b0-ab89-bd1f5b9064d7 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:31.491132 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] VM Started (Lifecycle Event)
Jun 26 02:43:31.494204 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:31.495873 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance spawned successfully.
Jun 26 02:43:31.497095 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:31.524120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:31.524645 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance network_info: |[{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:43:31.618929 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:31.624690 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Booting with volume ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d at /dev/vda
Jun 26 02:43:31.659742 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:31.671730 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:31.690698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:31.728484 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:31.728925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:31.737197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:31.738641 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe84:2d07', 'fe80::8c23:7fff:fe19:ee8c'] 
Jun 26 02:43:31.738756 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:31.738812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:31.739066 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:31.739244 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating existing volume attachment record: 247e2370-4d96-4c3a-9767-e3cd223057b0 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:31.761227 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:31.763497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:31.763497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:31.763497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] No VIF found with MAC fa:16:3e:de:76:61, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:31.844072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:31.858114 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:31.859261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:31.859396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:31.859563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:31.859708 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:31.859837 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-bcfb4099-4bec-4749-8c01-134b39b95676 req-972544ca-5b3c-44cc-9821-a39a1ef767d5 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state building and task_state block_device_mapping.
Jun 26 02:43:31.905681 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:31.973499 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:31.996059 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:31.997571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.006543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:32.134343 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:32.402148 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:32.412621 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:32.433531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:32.463676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:32.466419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:32.473825 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:32.475091 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe84:2d07', 'fe80::8c23:7fff:fe19:ee8c'] 
Jun 26 02:43:32.475227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:32.475300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:32.475559 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:32.475810 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating existing volume attachment record: 2ff57625-6a0c-4620-a2fc-bb0ad7431bcc {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:32.499786 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:32.500078 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441812.4999037, 162c03aa-0004-43b0-ab89-bd1f5b9064d7 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:32.500174 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] VM Paused (Lifecycle Event)
Jun 26 02:43:32.512014 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Took 7.54 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:32.512878 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:32.636502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c3f9bec8-0f81-41f0-8a55-c42e826f74ad req-450654f4-677d-423d-adf9-ed20fccc0ce8 service nova] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:32.637018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:32.638066 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:32.785686 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:32.948594 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:32.949093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:32.949093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:32.949093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:32.949209 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] No waiting events found dispatching network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:32.949241 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f9ad795b-bf12-4cf6-b766-085037b0b104 req-39da4841-d586-41dc-9e87-dafbd122abf6 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received unexpected event network-vif-plugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 for instance with vm_state active and task_state deleting.
Jun 26 02:43:33.002676 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:33.009552 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441813.006385, 162c03aa-0004-43b0-ab89-bd1f5b9064d7 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:33.009552 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] VM Resumed (Lifecycle Event)
Jun 26 02:43:33.024464 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Took 13.23 seconds to build instance.
Jun 26 02:43:33.203889 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:43:33.324343 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e0ea25c3-5410-40c6-87ad-f903b6379dd1 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.576s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:33.325833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:33.405941 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:33.510498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:33.511543 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:33.528913 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9103effa-3dd2-49d6-9b59-847d0760fc91 tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.743s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:33.531061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.203s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:33.531317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:33.531890 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:33.532211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:33.536412 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Terminating instance
Jun 26 02:43:33.564648 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:33.852679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:43:33.853851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:43:33.854240 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Creating image(s)
Jun 26 02:43:33.854580 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:43:33.854739 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:43:33.854969 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:33.855118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:33.855230 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:34.013680 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 26 02:43:34.051985 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:43:34.053986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:34.054253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:34.067448 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:34.067796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance network_info: |[{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:43:34.068496 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start _get_guest_xml network_info=[{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '247e2370-4d96-4c3a-9767-e3cd223057b0', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4bf23f6c-34b4-4cec-923b-3cbbc96839fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'serial': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:34.072070 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:34.073620 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2059963993', uuid='4bf23f6c-34b4-4cec-923b-3cbbc96839fa'), owner=OwnerMeta(userid='bc748533ff1b49ecbfc2f8e239350cea', username='tempest-ServerActionsTestOtherA-1295549616-project-member', projectid='f3004e12281740988b4f5119899f222b', projectname='tempest-ServerActionsTestOtherA-1295549616'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441814.0729525) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:34.082097 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.085368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:34.085368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:34.087766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:34.087766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:34.087995 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:34.088305 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:34.090614 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:34.096090 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.106861 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.109880 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:34.110362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:34.110535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:34.110903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:34.111103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:34.125472 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.129300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:34.129982 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:34.130535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:34.130782 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:34.131223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.132293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:34.132527 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:34.141620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:34.141620 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:34.147708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:34.147708 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d] added
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:34.155429 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:34.155703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:34.155857 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:34.156089 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d] added
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:34.159883 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:34.160235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:34.160235 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:34.160306 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:34.381359 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999754192999944 future=<Future at 0x72e27c2ab770 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:34.381787 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999315575999844 future=<Future at 0x72e27c2ab770 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:34.381935 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999150178000036 future=<Future at 0x72e27c2ab770 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:34.382677 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Instance destroyed successfully.
Jun 26 02:43:34.382966 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lazy-loading 'resources' on Instance uuid 162c03aa-0004-43b0-ab89-bd1f5b9064d7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:34.557037 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Detaching volume 3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:34.607087 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Attempting to driver detach volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 from mountpoint /dev/vdb
Jun 26 02:43:34.609584 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:43:34.614836 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:43:34.614953 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Creating image(s)
Jun 26 02:43:34.615283 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:43:34.615492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Ensure instance console log exists: /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:43:34.615754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:34.615947 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:34.616338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:34.616717 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start _get_guest_xml network_info=[{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2ff57625-6a0c-4620-a2fc-bb0ad7431bcc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8c307448-2d6a-4df3-b427-af9db2c9378a', 'attached_at': '', 'detached_at': '', 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'serial': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:34.619299 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:34.620365 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535', uuid='8c307448-2d6a-4df3-b427-af9db2c9378a'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441814.6200728) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:34.621183 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found disk vdb by alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:34.622106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:34.623069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found disk vdb by alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:34.623492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:34.623698 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Attempting to detach device vdb from instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:34.623997 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:34.625210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:34.625388 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:34.626205 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:34.626524 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:34.626677 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:34.626777 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:34.626913 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:34.627004 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:34.627083 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:34.627234 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:34.627346 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:34.627464 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:34.627628 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:34.627728 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:34.637422 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully detached device vdb from instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e from the persistent domain config.
Jun 26 02:43:34.637573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] (1/8): Attempting to detach device vdb with device alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 from instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:34.637879 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:34.639226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:34.639491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:34.639626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:34.662875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:34.664373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:34.885276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-238946782',display_name='tempest-VolumesNegativeTest-instance-238946782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesnegativetest-instance-238946782',id=19,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:32Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274330e1acd446d9c1a927c3382232d',ramdisk_id='',reservation_id='r-cln2l84y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1586592515',owner_user_name='tempest-VolumesNegativeTest-1586592515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:43:33Z,user_data=None,user_id='d2a3811e46e84a8282161cbb342b7060',uuid=162c03aa-0004-43b0-ab89-bd1f5b9064d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:43:34.885512 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converting VIF {"id": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "address": "fa:16:3e:84:2d:07", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap221dfdb4-42", "ovs_interfaceid": "221dfdb4-4266-40d9-9d50-efc8147c1c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:34.886102 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:34.886318 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:43:34.887488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.887698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap221dfdb4-42, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:34.888646 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.889340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:34.889932 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.890746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.890906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25187f51-8e16-4a91-9418-c35901287d6d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:34.891345 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.891834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:34.893017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:34.894912 np0000003683 nova-compute[98991]: INFO os_vif [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=221dfdb4-4266-40d9-9d50-efc8147c1c71,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap221dfdb4-42')
Jun 26 02:43:34.895220 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Deleting instance files /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7_del
Jun 26 02:43:34.895975 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Deletion of /opt/stack/data/nova/instances/162c03aa-0004-43b0-ab89-bd1f5b9064d7_del complete
Jun 26 02:43:35.005372 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:35.005803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:35.006006 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:35.006136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:35.006329 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] No waiting events found dispatching network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:35.006395 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:35.006520 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:35.006716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Acquiring lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:35.006856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:35.007000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:35.007134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] No waiting events found dispatching network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:35.007268 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c87e784e-caf5-41f7-b55d-b8e43db5b50a req-f119696c-62d1-49f9-8377-b84e6b33da09 service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-unplugged-221dfdb4-4266-40d9-9d50-efc8147c1c71 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:35.111224 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441815.1107748, 20a17f81-3782-44c1-a371-4b9c13ff0f6e => ua-3eee84d4-6489-46a8-8c03-0f4661b29d88> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:43:35.112340 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 for instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:43:35.114036 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully detached device vdb from instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e from the live domain config.
Jun 26 02:43:35.156786 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:35.160687 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:35.167419 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:35.169763 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:35.175435 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.182591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.188291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.194216 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.194216 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.194216 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:35.194393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.194393 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.194393 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:35.200747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.200747 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.200747 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:35.200930 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.200930 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.200930 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:35.228129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260]
Jun 26 02:43:35.228129 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:35.228129 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.240206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.244702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260]
Jun 26 02:43:35.244702 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:35.244702 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.253027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.253027 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.253027 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.253027 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.253027 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:35.253246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.253246 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.253246 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.253246 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.253246 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:35.253442 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:35.253625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:35.254331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:35.254460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:35.258396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:35.267956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:35.272467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.272467 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.272467 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.272467 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.272467 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:35.272797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.272797 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:35.272797 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.272797 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:35.272797 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:35.273013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:35.273167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:35.274030 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('10', '-', '-', 0) found on session 38 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:35.274119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:35.288239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:35.401967 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 26 02:43:35.402605 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:43:35.402804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:43:35.402917 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:43:35.403083 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:35.480709 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:35.660697 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Detected multiple connections on this host for volume: 3eee84d4-6489-46a8-8c03-0f4661b29d88, skipping target disconnect.
Jun 26 02:43:35.723335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fdb8589-9a7d-41cd-b859-4c4240019cf6 req-6a17f438-e1d6-4d17-ace5-e68f3077899e service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Received event network-vif-deleted-221dfdb4-4266-40d9-9d50-efc8147c1c71 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:35.723588 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-7fdb8589-9a7d-41cd-b859-4c4240019cf6 req-6a17f438-e1d6-4d17-ace5-e68f3077899e service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Neutron deleted interface 221dfdb4-4266-40d9-9d50-efc8147c1c71; detaching it from the instance and deleting it from the info cache
Jun 26 02:43:35.725062 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fdb8589-9a7d-41cd-b859-4c4240019cf6 req-6a17f438-e1d6-4d17-ace5-e68f3077899e service nova] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Detach interface failed, port_id=221dfdb4-4266-40d9-9d50-efc8147c1c71, reason: Instance 162c03aa-0004-43b0-ab89-bd1f5b9064d7 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:43:36.175979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:36.176408 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:36.225522 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:36.267802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:36.267950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:36.288556 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:36.288728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:36.619718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:36.678174 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Took 1.28 seconds to deallocate network for instance.
Jun 26 02:43:37.131289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:43:37.184149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:37.184611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:37.232410 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1360721d-4e38-4471-9460-2be1b90cbf9b tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.178s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:37.260311 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:37.260527 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:37.260970 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Attaching volume 3503bbb3-d5d3-4d48-8244-7830266b9ad4 to /dev/vdb
Jun 26 02:43:37.313896 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:37.324120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:37.342652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:37.373614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:37.373971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:37.381372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:37.382708 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] 
Jun 26 02:43:37.382819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:37.382912 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:37.383129 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== get_connector_properties: return (69ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:37.383353 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updating existing volume attachment record: ac50c70e-2a11-4eb1-b1cf-4450441eee1e {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:37.691581 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:37.691796 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:37.930317 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:37.933661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:37.933806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:38.146716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found WWN 330000000320fefc6 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:38.146716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:38.146716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '330000000320fefc6', 'path': '/dev/dm-1', 'multipath_id': '330000000320fefc6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:38.146716 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000320fefc6', 'path': '/dev/dm-1', 'multipath_id': '330000000320fefc6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:38.147194 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.507s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:38.147642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:38.159660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:38.160533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:38.161106 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:38.161367 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:38.161965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:38.162163 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:38.173122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:38.173122 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:38.178983 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:38.178983 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a] added
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:38.186721 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:38.187404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:38.187404 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:38.187404 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a] added
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:38.189534 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:38.189793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:38.189930 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:38.190063 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:38.194773 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:38.435098 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:38.435284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:38.654368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:43:38.654368 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:38.654368 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:38.654368 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf23f6c-34b4-4cec-923b-3cbbc96839fa {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:38.700934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.516s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:38.749250 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Deleted allocations for instance 162c03aa-0004-43b0-ab89-bd1f5b9064d7
Jun 26 02:43:38.937995 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Detaching volume 3eee84d4-6489-46a8-8c03-0f4661b29d88
Jun 26 02:43:38.973559 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Attempting to driver detach volume 3eee84d4-6489-46a8-8c03-0f4661b29d88 from mountpoint /dev/vdb
Jun 26 02:43:38.976383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found disk vdb by alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:38.977282 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Found disk vdb by alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:43:38.977417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Attempting to detach device vdb from instance 09adc163-d707-41cb-8c68-62c7284441f2 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:38.977694 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:38.981894 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully detached device vdb from instance 09adc163-d707-41cb-8c68-62c7284441f2 from the persistent domain config.
Jun 26 02:43:38.982012 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] (1/8): Attempting to detach device vdb with device alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 from instance 09adc163-d707-41cb-8c68-62c7284441f2 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <alias name="ua-3eee84d4-6489-46a8-8c03-0f4661b29d88"/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <serial>3eee84d4-6489-46a8-8c03-0f4661b29d88</serial>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:38.982221 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <uuid>4bf23f6c-34b4-4cec-923b-3cbbc96839fa</uuid>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <name>instance-00000015</name>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherA-server-2059963993</nova:name>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:34</nova:creationTime>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:user uuid="bc748533ff1b49ecbfc2f8e239350cea">tempest-ServerActionsTestOtherA-1295549616-project-member</nova:user>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:project uuid="f3004e12281740988b4f5119899f222b">tempest-ServerActionsTestOtherA-1295549616</nova:project>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         <nova:port uuid="3a3cdf50-439e-4f79-825f-6ff30b237db8">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="serial">4bf23f6c-34b4-4cec-923b-3cbbc96839fa</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="uuid">4bf23f6c-34b4-4cec-923b-3cbbc96839fa</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <alias name="ua-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <serial>ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d</serial>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:5e:76:38"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <target dev="tap3a3cdf50-43"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/console.log" append="off"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Preparing to wait for external event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:43:39.158502 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:39.163106 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:39.163106 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:43:39.163106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.163434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:39.163789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:43:39.164602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.164794 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '897ea652-5d54-5e55-b479-9438211867c0', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:39.165506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.166192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:39.166710 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.168814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.168994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a3cdf50-43, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:39.169324 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a3cdf50-43, col_values=(('qos', UUID('389d3fae-4e96-49f0-b1e9-91585de1305a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:39.169534 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a3cdf50-43, col_values=(('external_ids', {'iface-id': '3a3cdf50-439e-4f79-825f-6ff30b237db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:76:38', 'vm-uuid': '4bf23f6c-34b4-4cec-923b-3cbbc96839fa'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:39.170320 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.171998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:39.176182 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:39.177467 np0000003683 nova-compute[98991]: INFO os_vif [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43')
Jun 26 02:43:39.187732 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:39.190577 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:39.199135 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:39.201957 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.211439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.217939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.227974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.227974 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.227974 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.227974 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.227974 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:39.228237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.228237 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.228237 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.228237 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.228237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:39.233812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.233812 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.233812 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.233812 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.233812 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:39.233973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.233973 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.233973 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.233973 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.233973 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:39.258910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.40.100,3260]
Jun 26 02:43:39.258910 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:39.258910 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.268394 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.50.100,3260]
Jun 26 02:43:39.268394 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:39.268394 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.277729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.284526 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.293571 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.293810 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:39.294014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:39.294164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:39.295441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('11', '-', '-', 0) found on session 39 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:39.295568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.300580 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:39.300829 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:39.301019 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:39.301133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:39.301857 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('12', '-', '-', 0) found on session 40 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:39.301965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:39.313499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 39 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:39.313713 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:39.318907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:39.318907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:39.758121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ee9112bf-8850-4a69-8e31-afaaa652b49d tempest-VolumesNegativeTest-1586592515 tempest-VolumesNegativeTest-1586592515-project-member] Lock "162c03aa-0004-43b0-ab89-bd1f5b9064d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.229s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:40.163840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:43:40.694397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:40.694397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:40.694397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:5e:76:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:40.694397 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Using config drive
Jun 26 02:43:41.187656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Found WWN 3300000008f50d4e3 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:41.188809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:41.188993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== connect_volume: return (6549ms) {'type': 'block', 'scsi_wwn': '3300000008f50d4e3', 'path': '/dev/dm-4', 'multipath_id': '3300000008f50d4e3'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:41.189113 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f50d4e3', 'path': '/dev/dm-4', 'multipath_id': '3300000008f50d4e3'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:41.189662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.256s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:41.189972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:41.203513 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:41.205469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:41.205986 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:41.206386 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:41.207335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:41.207835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:41.208823 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:41.219001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:41.219001 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:41.228503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:41.228503 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4] added
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:41.232634 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4] added
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:41.244178 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:41.244417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:41.244569 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:41.244743 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:41.345784 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Creating config drive at /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config
Jun 26 02:43:41.350258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf1t0g2uv {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:41.362546 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441821.361148, 09adc163-d707-41cb-8c68-62c7284441f2 => ua-3eee84d4-6489-46a8-8c03-0f4661b29d88> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:43:41.363050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3eee84d4-6489-46a8-8c03-0f4661b29d88 for instance 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:43:41.366001 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully detached device vdb from instance 09adc163-d707-41cb-8c68-62c7284441f2 from the live domain config.
Jun 26 02:43:41.394867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf1t0g2uv" returned: 0 in 0.044s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:41.404231 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:43:41.404650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:41.404827 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:41.622067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.696660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-911558535',id=20,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-4q026pea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:29Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=8c307448-2d6a-4df3-b427-af9db2c9378a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:43:41.697055 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:41.697540 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:41.698169 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:41.794650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.827372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.831296 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.914545 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.965458 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:41.967818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.025154 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4a28a4a0-346d-48fd-86ac-2cec15c0a1c1 req-0769b7b3-bdd1-4c7e-a002-ca1d8cf8dfe7 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:42.025539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4a28a4a0-346d-48fd-86ac-2cec15c0a1c1 req-0769b7b3-bdd1-4c7e-a002-ca1d8cf8dfe7 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:42.025732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4a28a4a0-346d-48fd-86ac-2cec15c0a1c1 req-0769b7b3-bdd1-4c7e-a002-ca1d8cf8dfe7 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:42.025949 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4a28a4a0-346d-48fd-86ac-2cec15c0a1c1 req-0769b7b3-bdd1-4c7e-a002-ca1d8cf8dfe7 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:42.026129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4a28a4a0-346d-48fd-86ac-2cec15c0a1c1 req-0769b7b3-bdd1-4c7e-a002-ca1d8cf8dfe7 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Processing event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <uuid>8c307448-2d6a-4df3-b427-af9db2c9378a</uuid>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <name>instance-00000014</name>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-911558535</nova:name>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:34</nova:creationTime>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         <nova:port uuid="911b3e19-9e80-4d7e-8456-b91f56dc972b">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="serial">8c307448-2d6a-4df3-b427-af9db2c9378a</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="uuid">8c307448-2d6a-4df3-b427-af9db2c9378a</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <alias name="ua-5ce3e522-86e4-4a24-816c-59b9f9db1e9a"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <serial>5ce3e522-86e4-4a24-816c-59b9f9db1e9a</serial>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8a:e1:81"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <target dev="tap911b3e19-9e"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/console.log" append="off"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:43:42.201616 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Preparing to wait for external event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-911558535',id=20,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-4q026pea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:29Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=8c307448-2d6a-4df3-b427-af9db2c9378a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:43:42.205021 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.205579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:42.205579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:43:42.206740 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.206979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '209e395f-fc86-5810-a9a3-b67166500acf', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:42.210491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.212742 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:42.215826 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.216098 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap911b3e19-9e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:42.216494 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap911b3e19-9e, col_values=(('qos', UUID('7fc067eb-b772-4fd7-bab3-7868c36fb301')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:42.216740 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap911b3e19-9e, col_values=(('external_ids', {'iface-id': '911b3e19-9e80-4d7e-8456-b91f56dc972b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:e1:81', 'vm-uuid': '8c307448-2d6a-4df3-b427-af9db2c9378a'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:42.217817 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.220053 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:42.224945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:42.226939 np0000003683 nova-compute[98991]: INFO os_vif [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e')
Jun 26 02:43:42.231758 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:42.245212 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:42.250999 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:42.257988 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.264492 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.272505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.280088 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.280287 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.288770 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.289093 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:42.327573 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.40.100,3260]
Jun 26 02:43:42.327573 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:42.327573 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.337974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.50.100,3260]
Jun 26 02:43:42.337974 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:42.337974 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.343978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.349972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.362133 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.362368 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:42.362762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:42.362925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.366048 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:42.366282 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:42.367237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:42.367704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:42.368626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('13', '-', '-', 0) found on session 41 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:42.368626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:42.370022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('14', '-', '-', 0) found on session 42 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:42.370216 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:42.385707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 41 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:42.385707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:42.388238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 42 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:42.388238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:42.610089 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441822.6095629, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:42.610455 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:42.610724 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Started (Lifecycle Event)
Jun 26 02:43:42.612825 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:42.614690 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance spawned successfully.
Jun 26 02:43:42.615101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:43.113274 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:43.115228 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:43.123486 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.123689 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.124013 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.124688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.124688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.124793 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:43.209202 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:43:43.621215 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:43.621523 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441823.6213102, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:43.621681 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Paused (Lifecycle Event)
Jun 26 02:43:43.635694 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Took 9.78 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:43.636060 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:43.747290 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:43.747451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:43.747540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:8a:e1:81, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:43.748003 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Using config drive
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:44.092565 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c68fee5a-63bd-4c49-bc3d-62b98a9ad330 req-b02b3c59-68a8-4a39-973f-bf17e41f1fd0 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state active and task_state None.
Jun 26 02:43:44.125102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:44.132948 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441824.132564, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:44.133195 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Resumed (Lifecycle Event)
Jun 26 02:43:44.145617 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Took 19.53 seconds to build instance.
Jun 26 02:43:44.228028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found WWN 330000000d83a0e9a for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:44.228379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:44.228700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== connect_volume: return (6294ms) {'type': 'block', 'scsi_wwn': '330000000d83a0e9a', 'path': '/dev/dm-5', 'multipath_id': '330000000d83a0e9a'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:44.229419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d83a0e9a', 'path': '/dev/dm-5', 'multipath_id': '330000000d83a0e9a'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:44.229969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.825s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:44.232356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eee84d4-6489-46a8-8c03-0f4661b29d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:43:44.232581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:43:44.234957 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:44.255888 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:44.260995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:43:44.264934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', '36')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:44.264934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88', '35')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:44.264934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4ef420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:43:44.264934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:43:44.264934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Flush multipath device 330000000a35c7878 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:43:44.297037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:44.344916 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:44.345228 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:43:44.353598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:44.420892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:43:44.421178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:43:44.422238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:43:44.435306 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Creating config drive at /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config
Jun 26 02:43:44.438832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx8bluwb4 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:44.449507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:43:44.450102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:43:44.463447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.497199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx8bluwb4" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:44.501391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.40.100,3260]
Jun 26 02:43:44.501391 np0000003683 nova-compute[98991]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:44.501391 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.518003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.536409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.579750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.50.100,3260]
Jun 26 02:43:44.579750 np0000003683 nova-compute[98991]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-3eee84d4-6489-46a8-8c03-0f4661b29d88, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:44.579750 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.595539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:44.595951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:44.596099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] <== disconnect_volume: return (3191ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:44.596298 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:43:44.637533 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:44.641433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:44.651494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d834cb63-4481-4937-b1fb-9d2b5c5369dd tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.048s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:44.740018 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Attempting to attach volume 3503bbb3-d5d3-4d48-8244-7830266b9ad4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:   <alias name="ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4"/>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:   <serial>3503bbb3-d5d3-4d48-8244-7830266b9ad4</serial>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:44.741208 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:43:45.047625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.074659 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.077907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.096243 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:45.168916 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'flavor' on Instance uuid 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:45.178858 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.236795 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.237995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:45.284584 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b71d05bb-59aa-44ba-a17b-d1f55519fd89 req-7dbc88ff-0fd6-4c11-8f4f-99f5e63a9452 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:45.285560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b71d05bb-59aa-44ba-a17b-d1f55519fd89 req-7dbc88ff-0fd6-4c11-8f4f-99f5e63a9452 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:45.285560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b71d05bb-59aa-44ba-a17b-d1f55519fd89 req-7dbc88ff-0fd6-4c11-8f4f-99f5e63a9452 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:45.285560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b71d05bb-59aa-44ba-a17b-d1f55519fd89 req-7dbc88ff-0fd6-4c11-8f4f-99f5e63a9452 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:45.285560 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b71d05bb-59aa-44ba-a17b-d1f55519fd89 req-7dbc88ff-0fd6-4c11-8f4f-99f5e63a9452 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Processing event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:43:45.454470 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-changed-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:45.454635 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing instance network info cache due to event network-changed-5279d472-fd5f-40b3-9130-196439442d5b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:45.454790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] Acquiring lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:45.454879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] Acquired lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:45.455003 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Refreshing network info cache for port 5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:45.604447 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] instance snapshotting
Jun 26 02:43:45.746823 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Beginning live snapshot process
Jun 26 02:43:45.960934 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:45.982776 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:43:45.982776 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441825.9822707, 8c307448-2d6a-4df3-b427-af9db2c9378a => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:45.982776 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Started (Lifecycle Event)
Jun 26 02:43:45.986452 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:43:45.993792 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance spawned successfully.
Jun 26 02:43:45.994241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:43:46.175886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0cd01edf-3caa-4ac4-9a04-6f0d16b7259f tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.740s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:46.342071 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:46.342359 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:46.342724 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:43:46.343634 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:46.352029 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:46.488706 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:46.493137 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:46.500555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:46.500555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:46.500555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:46.500555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:c6:5c:b4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:46.506458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.506788 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.507135 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.507416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.507780 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.508816 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:43:46.524490 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updated VIF entry in instance network info cache for port 5279d472-fd5f-40b3-9130-196439442d5b. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:46.524828 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updating instance_info_cache with network_info: [{"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:46.625357 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:46.854053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:46.854731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:46.854731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:46.856623 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:43:46.962203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:46.963116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:46.963116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:46.963116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:46.963241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:46.965723 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Terminating instance
Jun 26 02:43:46.997909 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:43:46.997909 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441826.9966288, 8c307448-2d6a-4df3-b427-af9db2c9378a => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:46.997909 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Paused (Lifecycle Event)
Jun 26 02:43:47.014180 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Took 12.40 seconds to spawn the instance on the hypervisor.
Jun 26 02:43:47.014270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:47.027578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-22520114-40b1-49f5-a52e-f37e43c7c9f7 req-d3f953df-511d-4de6-aee1-6e5574ce56f5 service nova] Releasing lock "refresh_cache-5e673f64-351d-4b09-a3be-8316d3a50b5d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:47.068080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:47.068080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:47.068188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:47.068291 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:47.068407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:47.070687 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Terminating instance
Jun 26 02:43:47.218040 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.261700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:47.325304 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Stashing vm_state: active {{(pid=98991) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 26 02:43:47.348456 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:47.349076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:47.349848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:47.349848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:47.349848 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:47.349848 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3e7030b8-b8a5-4cab-a9e7-0bdf453d61ba req-881771bf-3f3a-4c32-a301-aa239eb20b9d service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state active and task_state None.
Jun 26 02:43:47.350331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:47.350848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:47.434499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json -f qcow2" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:47.434655 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:47.441103 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:47.441886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:47.471066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:43:47.500255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:47.503310 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.505782 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.516432 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441827.5135539, 8c307448-2d6a-4df3-b427-af9db2c9378a => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:47.516432 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Resumed (Lifecycle Event)
Jun 26 02:43:47.529727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.532712 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Took 23.18 seconds to build instance.
Jun 26 02:43:47.541551 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-changed-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:47.541762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Refreshing instance network info cache due to event network-changed-3a3cdf50-439e-4f79-825f-6ff30b237db8. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:43:47.542063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:47.542216 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:47.542401 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Refreshing network info cache for port 3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:43:47.545406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:47.546069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4.delta 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:47.575874 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:43:47.606634 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4.delta 1073741824" returned: 0 in 0.060s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:47.607086 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 26 02:43:47.623704 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.645581 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.691695 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.704246 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.721894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.754171 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.760200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:47.884110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:47.884402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:47.897054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:43:47.924920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:43:47.932783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:47.936989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:48.017638 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:48.020761 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:43:48.026297 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.036209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.692s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:48.047625 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:48.073865 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.081853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.089721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2479ce02-eb4a-41a0-841a-4c5c63145694 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.828s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:48.098551 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.178844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.221303 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.225696 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Instance destroyed successfully.
Jun 26 02:43:48.228534 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'resources' on Instance uuid 20a17f81-3782-44c1-a371-4b9c13ff0f6e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:48.228534 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.238817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.260916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.266026 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Instance destroyed successfully.
Jun 26 02:43:48.269406 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lazy-loading 'resources' on Instance uuid 09adc163-d707-41cb-8c68-62c7284441f2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:48.342446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.342885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.395150 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:48.396076 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Claim successful on node np0000003683
Jun 26 02:43:48.427921 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:43:48.430859 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 26 02:43:48.442539 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:48.444359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.452319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.465955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.471791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.486953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.513367 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:43:48.517088 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4.delta /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.542429 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998060440000017 future=<Future at 0x72e27c312cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:48.542829 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999787022999953 future=<Future at 0x72e27c32a900 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:48.567934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.569596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.595650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.608097 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:48.627210 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.682437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.685453 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.732576 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-2',id=14,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=<?>,launch_index=1,launched_at=2026-06-26T02:42:34Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=20a17f81-3782-44c1-a371-4b9c13ff0f6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:43:48.732576 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "address": "fa:16:3e:de:76:61", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5e14439-85", "ovs_interfaceid": "e5e14439-8594-4c1f-bf6f-bb4222d708cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:48.734722 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:48.736805 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:43:48.740162 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.740511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5e14439-85, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:48.751289 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:48.756217 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.758832 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.759001 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bab3a41-2644-4a36-b024-16363340a483) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:48.759818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.761557 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:48.769307 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.774519 np0000003683 nova-compute[98991]: INFO os_vif [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:76:61,bridge_name='br-int',has_traffic_filtering=True,id=e5e14439-8594-4c1f-bf6f-bb4222d708cc,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5e14439-85')
Jun 26 02:43:48.774972 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Deleting instance files /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e_del
Jun 26 02:43:48.775971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-722297010-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testmultiattachvolumeswap-server-722297010-1',id=13,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy7tEobLeh3W1orWeuXv50YeMhYv/RB1tc6tkc7nfY+KhKSBy1EnTN5yBAmTy4sJmfZQRkC6CAv/h/kDPbGgDGuVYQyH/UEBmDpHJkgcYszM1lchvkQrFk7WMMaVLk+A==',key_name='tempest-keypair-862151293',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:31Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e56820eb3004485daeddc34b9ff4b4f3',ramdisk_id='',reservation_id='r-3ibjh9lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1040529591',owner_user_name='tempest-TestMultiAttachVolumeSwap-1040529591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0040e623638942d88ab364c385d035d9',uuid=09adc163-d707-41cb-8c68-62c7284441f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:43:48.776147 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converting VIF {"id": "fce62866-1037-431b-ab1f-f852bca5d951", "address": "fa:16:3e:22:ec:a1", "network": {"id": "19b4d887-82f0-45b1-8620-3a61f1c7a98c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-173207011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e56820eb3004485daeddc34b9ff4b4f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce62866-10", "ovs_interfaceid": "fce62866-1037-431b-ab1f-f852bca5d951", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:48.777222 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:48.777222 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:43:48.778958 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.778958 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce62866-10, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:48.782441 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:48.782441 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Deletion of /opt/stack/data/nova/instances/20a17f81-3782-44c1-a371-4b9c13ff0f6e_del complete
Jun 26 02:43:48.784410 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.785513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:48.785513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=726dcb2e-6e8a-47c8-b7c4-963edc96e121) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:48.787411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:48.789995 np0000003683 nova-compute[98991]: INFO os_vif [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:a1,bridge_name='br-int',has_traffic_filtering=True,id=fce62866-1037-431b-ab1f-f852bca5d951,network=Network(19b4d887-82f0-45b1-8620-3a61f1c7a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce62866-10')
Jun 26 02:43:48.790276 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Deleting instance files /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2_del
Jun 26 02:43:48.791092 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Deletion of /opt/stack/data/nova/instances/09adc163-d707-41cb-8c68-62c7284441f2_del complete
Jun 26 02:43:48.797053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.797987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.814517 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4.delta /opt/stack/data/nova/instances/snapshots/tmp69u6ucgl/003c62e7db15454ab138ea57ce296ae4" returned: 0 in 0.297s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.827177 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updated VIF entry in instance network info cache for port 3a3cdf50-439e-4f79-825f-6ff30b237db8. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:43:48.828347 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:48.831390 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Snapshot extracted, beginning image upload
Jun 26 02:43:48.901672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:48.905321 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:48.926745 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating resource usage from migration 64feb7b6-fbab-435a-869a-a84c6f610bbd
Jun 26 02:43:49.014164 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.017498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.109286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.115840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.204159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.207497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.295706 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Took 1.72 seconds to destroy the instance on the hypervisor.
Jun 26 02:43:49.298642 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:43:49.299251 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:43:49.299331 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:43:49.306151 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:49.309047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.314397 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Took 1.84 seconds to destroy the instance on the hypervisor.
Jun 26 02:43:49.316701 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '20a17f81-3782-44c1-a371-4b9c13ff0f6e' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '20a17f81-3782-44c1-a371-4b9c13ff0f6e' (instance-0000000e)
Jun 26 02:43:49.317627 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:43:49.317757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:43:49.317873 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:43:49.318100 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:49.324214 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.349919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c9549ec-60ca-4db0-b4cf-ebede83764e7 req-011b9811-2239-4fdb-907a-81034451d8b2 service nova] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:49.381940 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0008358130000942765 future=<Future at 0x72e27c2ab770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:49.382055 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:49.382165 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.15812261799988 future=<Future at 0x72e27c312cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:49.382242 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.158034154999996 future=<Future at 0x72e27c312cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:49.382900 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441814.3810072, 162c03aa-0004-43b0-ab89-bd1f5b9064d7 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:43:49.383144 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] VM Stopped (Lifecycle Event)
Jun 26 02:43:49.440750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.441206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.476819 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:49.482031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.547s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.484151 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:49.498159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.498370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.498971 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.498971 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.499325 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.499325 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.499415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.499826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.499826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.499886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.500004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.500655 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.500655 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.500655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.500912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.501045 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.501155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.501582 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.501747 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.501908 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.502074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.502218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.502454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.502719 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.502854 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.503119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.503119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.503258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.503296 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.503563 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received unexpected event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with vm_state active and task_state deleting.
Jun 26 02:43:49.503723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.503796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.503899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.503999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.504102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.504186 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received unexpected event network-vif-plugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with vm_state active and task_state deleting.
Jun 26 02:43:49.504282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.504637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.504637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.504761 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.504761 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.504969 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.504969 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.505122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.505161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.505307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.505390 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] No waiting events found dispatching network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.505427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-unplugged-e5e14439-8594-4c1f-bf6f-bb4222d708cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:43:49.505609 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.505699 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.505807 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:49.505914 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:49.506035 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:49.506336 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-02a09039-4eed-4ca7-966a-114f3cb95b93 req-c398facd-1037-425d-9f03-bc86e8327f42 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received unexpected event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with vm_state active and task_state deleting.
Jun 26 02:43:49.531679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.537384 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:43:49.548839 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:43:49.550694 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:49.551948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:49.602847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:49.603596 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=49779MB free_disk=74.08337783813477GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:43:49.603848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:49.796516 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:49.796892 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:49.888754 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 162c03aa-0004-43b0-ab89-bd1f5b9064d7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:49.922267 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-767b80a0-e886-43fd-bd36-8a909d1227c1 req-bc606de4-b2e4-44de-9f40-528819af5a65 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Received event network-vif-deleted-e5e14439-8594-4c1f-bf6f-bb4222d708cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:49.923617 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-767b80a0-e886-43fd-bd36-8a909d1227c1 req-bc606de4-b2e4-44de-9f40-528819af5a65 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Neutron deleted interface e5e14439-8594-4c1f-bf6f-bb4222d708cc; detaching it from the instance and deleting it from the info cache
Jun 26 02:43:49.924491 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-767b80a0-e886-43fd-bd36-8a909d1227c1 req-bc606de4-b2e4-44de-9f40-528819af5a65 service nova] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Detach interface failed, port_id=e5e14439-8594-4c1f-bf6f-bb4222d708cc, reason: Instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:43:50.048881 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Rescuing
Jun 26 02:43:50.050923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:50.051907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:50.055028 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:50.302055 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:50.367029 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:50.534499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:50.534499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:50.534499 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attaching volume 685e3e90-c453-499b-9807-d2eb1d4b3182 to /dev/vdb
Jun 26 02:43:50.557951 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:50.588391 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:50.600011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:50.627667 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:50.668700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:50.669041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:50.677453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:50.678715 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe5e:7638', 'fe80::fc16:3eff:fe8a:e181'] 
Jun 26 02:43:50.678872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:50.679109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:50.679374 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:50.679663 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating existing volume attachment record: 2295e721-a68b-46a7-ac00-22e4c5e67d58 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:50.740120 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:50.811029 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.926s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:50.811207 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Migrating
Jun 26 02:43:50.811449 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:43:50.817713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.214s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:50.870770 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Took 1.57 seconds to deallocate network for instance.
Jun 26 02:43:50.910656 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:51.097737 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating instance_info_cache with network_info: [{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:51.236576 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:51.237057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:51.237250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:51.237698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:51.237950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:51.246427 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Took 1.93 seconds to deallocate network for instance.
Jun 26 02:43:51.253392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:51.253870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:51.254370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:51.254572 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:51.257888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:51.258243 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:51.268812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:51.268812 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:51.276511 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:51.276511 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182] added
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:51.282910 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:51.283229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:51.283348 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:51.283599 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182] added
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:51.287469 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:51.287880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:51.290036 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:51.290036 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:51.342053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:51.342536 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:51.342536 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:51.379123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.542262 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received unexpected event network-vif-plugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with vm_state deleted and task_state None.
Jun 26 02:43:51.544039 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:51.544308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.544427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:51.544672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:51.544672 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:51.544853 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received unexpected event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with vm_state deleted and task_state None.
Jun 26 02:43:51.544980 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:51.545159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Acquiring lock "09adc163-d707-41cb-8c68-62c7284441f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.549988 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:51.550142 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] Lock "09adc163-d707-41cb-8c68-62c7284441f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:51.550291 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] No waiting events found dispatching network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:51.550451 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received unexpected event network-vif-unplugged-fce62866-1037-431b-ab1f-f852bca5d951 for instance with vm_state deleted and task_state None.
Jun 26 02:43:51.550621 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-790e0d6a-1efd-4d91-ad3b-de200f39f7eb req-7612a0c6-f088-4f16-852e-995624828d79 service nova] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Received event network-vif-deleted-fce62866-1037-431b-ab1f-f852bca5d951 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:51.586464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.586709 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:51.601090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:51.627245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:51.755257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:51.772893 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Snapshot image upload complete
Jun 26 02:43:51.772893 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0c80c84a-8336-4fd4-8906-42e3192abedf tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Took 6.17 seconds to snapshot the instance on the hypervisor.
Jun 26 02:43:51.853813 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:51.857075 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Applying migration context for instance 4bf23f6c-34b4-4cec-923b-3cbbc96839fa as it has an incoming, in-progress migration 64feb7b6-fbab-435a-869a-a84c6f610bbd. Migration status is pre-migrating {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 26 02:43:51.858119 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating resource usage from migration 64feb7b6-fbab-435a-869a-a84c6f610bbd
Jun 26 02:43:51.922582 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.922725 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 09adc163-d707-41cb-8c68-62c7284441f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.922833 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.922903 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ddf5057b-2a8e-4974-934e-1f89155d50f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.922994 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 110dbeda-4ed0-4234-863e-7441034d8449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.923068 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.923145 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance cb30fcf0-34d3-4008-b128-9bd46080c204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.923224 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8c307448-2d6a-4df3-b427-af9db2c9378a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:51.923316 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Migration 64feb7b6-fbab-435a-869a-a84c6f610bbd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 26 02:43:51.923451 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 4bf23f6c-34b4-4cec-923b-3cbbc96839fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:43:52.088470 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:43:52.204629 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:52.285544 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:52.290840 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:52.301103 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:52.313635 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.321663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.327103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.337183 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.337578 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.349032 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:52.391901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260]
Jun 26 02:43:52.391901 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:52.391901 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.407642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.419759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260]
Jun 26 02:43:52.419759 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:52.419759 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.427547 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 26 02:43:52.427547 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:43:52.427547 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:43:49 up 30 min,  2 users,  load average: 7.47, 5.26, 2.58\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '4', 'num_os_type_None': '9', 'num_proj_f3004e12281740988b4f5119899f222b': '2', 'io_workload': '2', 'num_proj_a94375dca8764ff8b335b461730d4cdb': '1', 'num_task_image_uploading': '1', 'num_proj_0aeb950792b84ac38e258cbabc9785b2': '1', 'num_proj_f149d284f0d24070afe71cccd4c0c744': '1', 'num_proj_5bb8ac3d99734c44bd220c90726dd72d': '2', 'num_task_rescuing': '1', 'num_task_resize_prep': '1', 'num_task_deleting': '2', 'num_proj_e56820eb3004485daeddc34b9ff4b4f3': '2'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.429964 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.430265 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:52.430783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:52.430869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:52.432557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('8', '-', '-', 0) found on session 44 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:52.432849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:52.439772 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:43:52.443323 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:52.455834 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 44 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:52.456089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.462693 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:52.463149 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:52.463728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:52.464074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:52.465404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('15', '-', '-', 0) found on session 45 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:52.465553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:52.480127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:52.669724 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:52.756703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:52.760134 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:52.790542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:52.938418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:52.945170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:52.946416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:43:53.058306 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:53.075536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:53.093501 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999712695000198 future=<Future at 0x72e27c2aa270 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:53.098204 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance destroyed successfully.
Jun 26 02:43:53.098779 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:53.151712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:53.151931 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:53.365794 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:53.366303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:53.479284 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:53.479520 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:53.603324 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Attempting a stable device rescue
Jun 26 02:43:53.613499 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:53.615555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:53.615555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:53.615555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:53.615555 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:53.615555 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state active and task_state rescuing.
Jun 26 02:43:53.615927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:53.615927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:53.615927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:53.616063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:53.616115 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:53.617091 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-24a8f659-7a33-4b0c-9bed-50ad49954a4e req-5eecb311-5b48-4119-9424-59e7ab8b63ef service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state active and task_state rescuing.
Jun 26 02:43:53.654642 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:53.699488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:43:53.703652 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:43:53.703863 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Creating image(s)
Jun 26 02:43:53.704572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:53.704806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:53.706543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:53.706543 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:53.794229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:53.869633 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'flavor' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:54.161210 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:43:54.161451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.344s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:54.161750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.784s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:54.162030 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:43:54.207722 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:43:54.208068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:54.208501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:54.277417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found WWN 33000000071d62c9d for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:54.277824 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:54.278017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000071d62c9d', 'path': '/dev/dm-0', 'multipath_id': '33000000071d62c9d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:54.278175 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000071d62c9d', 'path': '/dev/dm-0', 'multipath_id': '33000000071d62c9d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:54.290415 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:54.461384 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Starting migrate_disk_and_power_off {{(pid=98991) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}}
Jun 26 02:43:54.489730 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.498273 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.520579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.673855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.679659 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:54.680748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:54.680748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:54.680748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:54.680874 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:54.681028 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-6ca79f2e-e6d4-4253-9cea-d9cf8a40dca5 req-c8a92fb9-50c8-43e5-bc8f-eff4b22d5085 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state active and task_state resize_migrating.
Jun 26 02:43:54.696205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.785844 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:54.790393 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:54.790393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:54.813234 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attempting to attach volume 685e3e90-c453-499b-9807-d2eb1d4b3182 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:   <alias name="ua-685e3e90-c453-499b-9807-d2eb1d4b3182"/>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:   <serial>685e3e90-c453-499b-9807-d2eb1d4b3182</serial>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:43:54.816814 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:43:54.817725 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999524795999832 future=<Future at 0x72e27c2b3500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:54.822274 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance destroyed successfully.
Jun 26 02:43:54.825367 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:43:54.825367 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:43:54.826192 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:43:54.826894 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:43:54.828607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.828950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a3cdf50-43, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:54.836921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:54.843296 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.844871 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.845118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389d3fae-4e96-49f0-b1e9-91585de1305a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:43:54.845985 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.846572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:43:54.852718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:54.854996 np0000003683 nova-compute[98991]: INFO os_vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43')
Jun 26 02:43:54.859712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:43:54.860155 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:54.860344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:54.860793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:54.861176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:43:54.861343 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:43:54.877968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:54.889172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.part --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:54.892871 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] 62bf958f-9851-45be-90d7-a4bcc687e608 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:43:54.893578 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:43:54.893898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.part /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:54.919889 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:54.920288 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:54.920940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '45')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:43:54.921317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '37')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:54.923080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '38')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:43:54.924357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4ef9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:43:54.924579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:43:54.924917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flush multipath device 330000000320fefc6 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:43:54.926891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:54.927260 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:54.990042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:54.998103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.part /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.converted" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:55.010577 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:55.045748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:43:55.087270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:43:55.087448 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:43:55.088657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:43:55.100318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:43:55.100697 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:43:55.101401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:55.102409 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.894s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:55.103169 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:55.106296 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:55.107676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:55.108222 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:55.108571 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:55.111278 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:43:55.111961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:55.112911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.149450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260]
Jun 26 02:43:55.149450 np0000003683 nova-compute[98991]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:55.149450 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.162205 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:55.162445 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:55.162739 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:55.162941 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:55.163130 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:43:55.163312 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:43:55.163631 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.18 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:43:55.169039 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.179867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.204956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:55.205558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac,backing_fmt=raw /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:55.221504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260]
Jun 26 02:43:55.221504 np0000003683 nova-compute[98991]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:55.221504 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.241503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:55.242178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:55.242381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== disconnect_volume: return (381ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:55.242627 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:43:55.246502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:43:55.247087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa_resize/disk.config /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:55.290639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b32a4f280f66b528657b343cfcd5c7152f3132ac,backing_fmt=raw /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.rescue" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:55.291377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "b32a4f280f66b528657b343cfcd5c7152f3132ac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:55.292232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "cp -r /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa_resize/disk.config /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:55.292818 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'migration_context' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:55.432884 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:55.798498 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:43:55.799135 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:43:55.799399 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start _get_guest_xml network_info=[{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:8a:e1:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '62bf958f-9851-45be-90d7-a4bcc687e608', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2ff57625-6a0c-4620-a2fc-bb0ad7431bcc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '8c307448-2d6a-4df3-b427-af9db2c9378a', 'attached_at': '', 'detached_at': '', 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'serial': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:43:55.799735 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:55.940464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.779s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:55.941887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.187s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:55.963412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:55.963656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:55.963843 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attaching volume 0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 to /dev/vdb
Jun 26 02:43:56.007578 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Deleted allocations for instance 20a17f81-3782-44c1-a371-4b9c13ff0f6e
Jun 26 02:43:56.011050 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:56.023214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:43:56.045789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:56.078770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:43:56.079293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:43:56.086755 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:43:56.087943 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] 
Jun 26 02:43:56.088018 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:43:56.088110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:43:56.088308 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:56.088563 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating existing volume attachment record: 02e6f3f4-a276-43af-8e02-3af00ee2059f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:43:56.301605 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:43:56.303906 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:43:56.305297 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535', uuid='8c307448-2d6a-4df3-b427-af9db2c9378a'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:8a:e1:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441836.3049295) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:43:56.306322 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:43:56.306717 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:43:56.307540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:43:56.307747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:43:56.308702 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:43:56.309080 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:43:56.309264 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:43:56.309503 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:43:56.309601 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:43:56.309736 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:43:56.309880 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:43:56.310086 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:43:56.310250 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:43:56.310463 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:43:56.310649 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:43:56.310817 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:43:56.311004 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:56.433201 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:56.433548 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:56.465847 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:56.466097 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:56.494494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:56.494643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:56.494783 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:43:56.494907 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:39:e3:37, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:43:56.500523 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Port 3a3cdf50-439e-4f79-825f-6ff30b237db8 binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:43:56.629774 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:56.643623 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:56.643990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:56.644214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:56.644516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:56.644747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:56.658264 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:56.658887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:56.659332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:56.659552 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:56.660046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:56.660235 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:56.670273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:56.670273 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:56.675013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:43:56.675013 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6] added
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:56.681824 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:56.682075 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:56.682212 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:56.682397 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6] added
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:43:56.687063 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:56.687296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:43:56.687522 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:43:56.687676 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:56.753984 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-dd524a0e-bfaa-42ba-ab4f-20834b0f2e61 req-9638b12b-6456-495c-9982-3044fcd763f9 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state active and task_state resize_migrating.
Jun 26 02:43:56.813216 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:43:56.823037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:43:56.914752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:43:56.915464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:56.915464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:56.916270 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:56.916446 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:43:56.916923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:43:56.917145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:56.969643 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:57.017769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-58eea17f-dc03-49c0-9f80-3958cf63d0ca tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "20a17f81-3782-44c1-a371-4b9c13ff0f6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.950s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:57.477919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.536s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:57.480173 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.809s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:57.483910 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:43:57.484031 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Claim successful on node np0000003683
Jun 26 02:43:57.509671 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:43:57.521469 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:57.521773 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:57.521904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:57.545779 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Deleted allocations for instance 09adc163-d707-41cb-8c68-62c7284441f2
Jun 26 02:43:57.683061 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:57.688166 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:57.695416 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:57.702222 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.707728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.715188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.727626 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.727865 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.732644 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.732823 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:57.767818 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.40.100,3260]
Jun 26 02:43:57.767818 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.40.100,3260] successful.
Jun 26 02:43:57.767818 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.778748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.787874 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.50.100,3260]
Jun 26 02:43:57.787874 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.50.100,3260] successful.
Jun 26 02:43:57.787874 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.795594 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.795814 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:57.796189 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:57.796392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:57.797319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] HCTL ('9', '-', '-', 0) found on session 46 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:57.797424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:57.799084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:57.811017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching for a device in session 46 and hctl ['9', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.817968 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:57.818424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:57.818692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:57.819339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] HCTL ('10', '-', '-', 0) found on session 47 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:57.819438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:57.847884 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching for a device in session 47 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:57.848169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:58.068292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5d351233-e343-44db-b9cc-8d4f801c6425 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.536s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:58.533846 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:58.556784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dca7a57f-cf65-4086-b579-bd98f2f3b18d tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Lock "09adc163-d707-41cb-8c68-62c7284441f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.594s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:58.561050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:58.562492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:58.563036 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:43:58.565631 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98991) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 26 02:43:58.566124 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:58.617073 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:43:58.617251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:43:58.617412 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:43:58.811393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching for a device in session 46 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:58.813949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:58.979399 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:43:58.979399 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:43:59.125703 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:59.472765 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:43:59.483339 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:43:59.603357 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.614283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.632400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.636492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.672234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.676182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Found WWN 330000000329ddc43 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:43:59.676538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:59.676735 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000329ddc43', 'path': '/dev/dm-1', 'multipath_id': '330000000329ddc43'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:43:59.676867 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000329ddc43', 'path': '/dev/dm-1', 'multipath_id': '330000000329ddc43'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:43:59.678018 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.761s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:59.678275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:43:59.683203 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'flavor' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:59.694315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:59.695100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:43:59.695663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:59.695945 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:43:59.696753 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:43:59.696753 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:59.710697 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:43:59.722647 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:59.728311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:59.742325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.744753 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:59.745400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:59.745400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:59.747443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('11', '0', '0', 0) found on session 39 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:59.747653 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:59.758793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 39 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:59.759081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.759915 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:43:59.760126 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:43:59.760311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:43:59.760430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:43:59.761070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('12', '0', '0', 0) found on session 40 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:43:59.761166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:43:59.769635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 40 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:43:59.770323 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:43:59.845517 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:43:59.857257 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:43:59.857752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:43:59.857940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:43:59.858059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:59.858168 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:43:59.858303 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-138cbba6-dcf4-423d-a99d-44db3b39eea4 req-71e24c5e-af59-48fc-b120-7852bf3a90cc service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state active and task_state powering-off.
Jun 26 02:43:59.916941 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999523582999927 future=<Future at 0x72e27c4d1d90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:43:59.918431 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance destroyed successfully.
Jun 26 02:43:59.918856 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'numa_topology' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:43:59.992847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.515s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:43:59.993348 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:00.130313 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:00.187439 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attempting to attach volume 0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:   <alias name="ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6"/>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:   <serial>0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6</serial>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:44:00.188741 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:44:00.422783 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:00.423159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:00.504523 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:00.504775 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:00.505498 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:00.505498 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:00.523304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:00.583078 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19a74f26e27346dc9badc9eb4476dfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94375dca8764ff8b335b461730d4cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:00.632442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:00.697431 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:44:00.929214 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e6074de2-747b-4311-9f36-b8c053ddcfc5 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.367s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:00.998089 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Successfully created port: 3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:01.007553 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:01.147036 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:01.157737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:44:01.182224 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:01.218118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:44:01.219529 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:44:01.229263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:44:01.230620 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] 
Jun 26 02:44:01.230813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:44:01.230917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:44:01.231160 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:01.397343 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:01.512522 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:01.629436 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:01.652056 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Successfully updated port: 3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:01.715227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Found WWN 3300000008f50d4e3 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:44:01.715227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:01.715227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== connect_volume: return (4797ms) {'type': 'block', 'scsi_wwn': '3300000008f50d4e3', 'path': '/dev/dm-4', 'multipath_id': '3300000008f50d4e3'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:01.715227 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f50d4e3', 'path': '/dev/dm-4', 'multipath_id': '3300000008f50d4e3'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:44:01.833946 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:01.834216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:01.834323 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:01.834509 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No VIF found with MAC fa:16:3e:3c:62:40, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:01.901146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:01.901256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquired lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:01.901378 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:01.901558 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'info_cache' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:01.928738 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:01.929031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:01.929473 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:01.929689 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:01.929871 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:01.930054 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state stopped and task_state powering-on.
Jun 26 02:44:01.930198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-changed-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:01.930335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Refreshing instance network info cache due to event network-changed-3439bbb0-3253-40bb-bd4e-e0859ce37da3. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:01.930514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Acquiring lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:01.930643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Acquired lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:01.930764 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Refreshing network info cache for port 3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:02.024437 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:02.154143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:02.221604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-911558535',id=20,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:47Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-4q026pea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:47Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=8c307448-2d6a-4df3-b427-af9db2c9378a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:8a:e1:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:02.221811 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:8a:e1:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:02.222351 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:02.223032 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:02.371255 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Starting finish_migration {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}}
Jun 26 02:44:02.372295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:44:02.372437 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Creating image(s)
Jun 26 02:44:02.372752 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:44:02.372914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:02.373200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:02.373340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:02.373460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:02.374077 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start _get_guest_xml network_info=[{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4a7eb951-af4e-4417-81a4-3626fe59656e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '4bf23f6c-34b4-4cec-923b-3cbbc96839fa', 'attached_at': '2026-06-26T02:44:01.000000', 'detached_at': '', 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'serial': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:02.377387 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:02.378418 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2059963993', uuid='4bf23f6c-34b4-4cec-923b-3cbbc96839fa'), owner=OwnerMeta(userid='bc748533ff1b49ecbfc2f8e239350cea', username='tempest-ServerActionsTestOtherA-1295549616-project-member', projectid='f3004e12281740988b4f5119899f222b', projectname='tempest-ServerActionsTestOtherA-1295549616'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441842.378118) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:02.379397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:02.379810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:02.383531 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:02.384122 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:02.384988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:02.385231 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:02.385350 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:02.385437 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:02.385576 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:02.385749 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:02.385804 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:02.385894 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:02.386044 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:02.386118 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:02.386185 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:02.386290 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:02.395083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.408741 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:02.433418 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:02.484810 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.485230 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:02.485458 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:02.485974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:02.486344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:44:02.487120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:02.487304 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:02.487678 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:02.487970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:44:02.502158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:02.503936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:02.503936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:02.503936 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:02.504615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:02.504615 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:02.512023 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:02.514967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:02.514967 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:02.520530 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:02.522059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:02.522059 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:02.522458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:02.522740 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Creating image(s)
Jun 26 02:44:02.523336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:02.523532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:02.524168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:02.524749 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:02.528335 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d] added
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:02.529237 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:02.529421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:02.529735 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:02.529906 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:02.530432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d] added
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:02.544705 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:02.616725 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.617746 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:02.618129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:02.618612 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:02.623391 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:02.625352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.661168 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:02.716762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.717197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.729855 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <uuid>8c307448-2d6a-4df3-b427-af9db2c9378a</uuid>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <name>instance-00000014</name>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-911558535</nova:name>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:43:56</nova:creationTime>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         <nova:port uuid="911b3e19-9e80-4d7e-8456-b91f56dc972b">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="serial">8c307448-2d6a-4df3-b427-af9db2c9378a</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="uuid">8c307448-2d6a-4df3-b427-af9db2c9378a</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <alias name="ua-5ce3e522-86e4-4a24-816c-59b9f9db1e9a"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <serial>5ce3e522-86e4-4a24-816c-59b9f9db1e9a</serial>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.rescue"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <boot order="1"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8a:e1:81"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <target dev="tap911b3e19-9e"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/console.log" append="off"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:02.732072 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:02.738033 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance destroyed successfully.
Jun 26 02:44:02.770220 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk 1073741824" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.770700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:02.771081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.828070 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:02.851388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.852210 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:02.852790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:02.912553 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:02.933719 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:02.934063 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Cannot resize image /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:02.934412 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:02.934591 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Ensure instance console log exists: /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:02.934892 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:02.935089 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:02.935233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:03.165681 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c809330c-d71d-4bee-94e5-004ff40c6d1e req-90df1bb9-12bf-4b95-a8a0-4f5840744562 service nova] Releasing lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:03.166154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquired lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:03.166344 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:03.198594 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:03.320872 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:03.397673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a22d9843-fb07-4a5f-9598-5bc27a094678 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.434s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:03.459871 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:03.460455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:03.460695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:03.461034 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:03.461157 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] No waiting events found dispatching network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:03.461285 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-5d4098ab-a9cb-4c1a-a084-c013747a7a5b req-007f45ff-3579-4090-845c-bc8a382be19c service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received unexpected event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 for instance with vm_state building and task_state spawning.
Jun 26 02:44:03.532017 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:03.541313 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0009758740000052057 future=<Future at 0x72e27c312cf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.541551 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.541686 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.0009234310000465484 future=<Future at 0x72e27c32a900 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.541770 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.0008296779999454884 future=<Future at 0x72e27c32a900 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.542797 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00018454099995324214 future=<Future at 0x72e27c32a900 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.542871 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.542981 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.550228164000146 future=<Future at 0x72e27c2aa270 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.543465 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.549969813000189 future=<Future at 0x72e27c2aa270 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:03.543465 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441828.5401113, 20a17f81-3782-44c1-a371-4b9c13ff0f6e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:03.543574 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] VM Stopped (Lifecycle Event)
Jun 26 02:44:03.544933 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441828.5425634, 09adc163-d707-41cb-8c68-62c7284441f2 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:03.545166 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] VM Stopped (Lifecycle Event)
Jun 26 02:44:03.547497 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:03.550894 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:03.561655 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.566747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.573590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.587398 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.587684 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.594434 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.594764 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:03.632500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260]
Jun 26 02:44:03.632500 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:03.632500 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.643797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.651764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260]
Jun 26 02:44:03.651764 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:03.651764 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.662043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.662397 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:03.662638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:03.662638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:03.663252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:03.664544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('7', '-', '-', 0) found on session 48 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:03.664693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:03.683854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 48 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:03.684382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:03.685953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:03.686740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:03.687011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] HCTL ('16', '-', '-', 0) found on session 49 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:03.687109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:03.721838 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Searching for a device in session 49 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:03.722042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:03.744295 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:03.823424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Releasing lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:03.940496 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:04.050997 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 20a17f81-3782-44c1-a371-4b9c13ff0f6e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:04.052439 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bf6c8442-7285-49cf-978f-217ff35f3b9c tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 09adc163-d707-41cb-8c68-62c7284441f2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:04.096745 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Updating instance_info_cache with network_info: [{"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:04.195100 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Rescuing
Jun 26 02:44:04.195454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:04.195454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:04.195590 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:04.260186 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:04.260315 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:04.260408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:04.260526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:8a:e1:81, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:04.261016 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Using config drive
Jun 26 02:44:04.505112 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:44:04.599405 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Releasing lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:04.599405 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance network_info: |[{"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:04.601611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Start _get_guest_xml network_info=[{"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:04.604501 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:04.605780 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1808343751', uuid='8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107'), owner=OwnerMeta(userid='19a74f26e27346dc9badc9eb4476dfa1', username='tempest-AttachVolumeNegativeTest-918921231-project-member', projectid='a94375dca8764ff8b335b461730d4cdb', projectname='tempest-AttachVolumeNegativeTest-918921231'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441844.6052637) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:04.608669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:04.609450 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:04.610604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:04.611514 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:04.611763 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:04.612206 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:04.612206 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:04.612206 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:04.612465 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:04.612465 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:04.612465 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:04.612670 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:04.613332 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:04.613332 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:04.613332 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:04.613332 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:04.629593 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1808343751',display_name='tempest-AttachVolumeNegativeTest-server-1808343751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1808343751',id=22,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO824Ndzq2svfuZhFVCpXk/lE/lW/ykIY4Z5J3eUYFAvZfKj0Rriz27p2Le2sgtu58ONs0QBedvs6lz12bZ+/ey6rnWh0qIxlyvi533avs929W9RXu7J1qosQDz3LaRs4g==',key_name='tempest-keypair-961925864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-o30hi8f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:04.629760 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:04.630368 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:04.630904 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:04.635828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:04.697811 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:04.763601 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:04.834382 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance destroyed successfully.
Jun 26 02:44:04.834739 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'numa_topology' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:04.846855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.064080 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <uuid>8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107</uuid>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <name>instance-00000016</name>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1808343751</nova:name>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:04</nova:creationTime>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:user uuid="19a74f26e27346dc9badc9eb4476dfa1">tempest-AttachVolumeNegativeTest-918921231-project-member</nova:user>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:project uuid="a94375dca8764ff8b335b461730d4cdb">tempest-AttachVolumeNegativeTest-918921231</nova:project>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         <nova:port uuid="3439bbb0-3253-40bb-bd4e-e0859ce37da3">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="serial">8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="uuid">8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.config"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:a5:10:27"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <target dev="tap3439bbb0-32"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/console.log" append="off"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:05.134037 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Preparing to wait for external event network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1808343751',display_name='tempest-AttachVolumeNegativeTest-server-1808343751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1808343751',id=22,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO824Ndzq2svfuZhFVCpXk/lE/lW/ykIY4Z5J3eUYFAvZfKj0Rriz27p2Le2sgtu58ONs0QBedvs6lz12bZ+/ey6rnWh0qIxlyvi533avs929W9RXu7J1qosQDz3LaRs4g==',key_name='tempest-keypair-961925864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-o30hi8f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:05.136231 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:05.136736 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:05.137084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.137154 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.137378 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:05.140640 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.140877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d9e6d65-655e-5c53-94ae-8b7e2ea5c32a', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.150264 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.151231 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:05.164435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.171917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.171917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3439bbb0-32, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.171917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3439bbb0-32, col_values=(('qos', UUID('075bc876-42e9-4672-adab-5f9990e3ea60')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.171917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3439bbb0-32, col_values=(('external_ids', {'iface-id': '3439bbb0-3253-40bb-bd4e-e0859ce37da3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:10:27', 'vm-uuid': '8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.172390 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.174977 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:05.188402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.189599 np0000003683 nova-compute[98991]: INFO os_vif [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32')
Jun 26 02:44:05.216765 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:05.268766 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:05.268867 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'keypairs' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:05.336720 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:05.337036 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'resources' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:05.497909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.521795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Found WWN 330000000320fefc6 for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:44:05.522067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:05.522275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000320fefc6', 'path': '/dev/dm-2', 'multipath_id': '330000000320fefc6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:05.522398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000320fefc6', 'path': '/dev/dm-2', 'multipath_id': '330000000320fefc6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:44:05.718642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:05.773261 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:05.780568 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:05.839237 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:05.839992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:44:05.840690 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:05.841268 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:05.841501 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:44:05.843253 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.843415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a37bc6-1d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.844655 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.846425 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:05.857284 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.863775 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.863991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1f99d4d-0b46-4cbb-8416-95b3137924ab) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:05.864793 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.865434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:05.874276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:05.878116 np0000003683 nova-compute[98991]: INFO os_vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:44:05.879599 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:44:05.879919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:05.880055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:05.880408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:05.880801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:44:05.880955 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:05.919760 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:05.920120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '49')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:44:05.920727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '44')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:05.921296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '45')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:05.922276 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c2d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:44:05.922491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Removing multipathed devices sdj, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:44:05.923158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flush multipath device 33000000071d62c9d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:44:05.940010 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Creating config drive at /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config.rescue
Jun 26 02:44:05.946500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc59dmj2t {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:05.964994 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:06.008466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc59dmj2t" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:06.027663 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:06.029638 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:06.030596 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:06.033788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <uuid>4bf23f6c-34b4-4cec-923b-3cbbc96839fa</uuid>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <name>instance-00000015</name>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <memory>262144</memory>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerActionsTestOtherA-server-2059963993</nova:name>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:02</nova:creationTime>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.micro" id="84">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:memory>256</nova:memory>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:user uuid="bc748533ff1b49ecbfc2f8e239350cea">tempest-ServerActionsTestOtherA-1295549616-project-member</nova:user>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:project uuid="f3004e12281740988b4f5119899f222b">tempest-ServerActionsTestOtherA-1295549616</nova:project>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         <nova:port uuid="3a3cdf50-439e-4f79-825f-6ff30b237db8">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="serial">4bf23f6c-34b4-4cec-923b-3cbbc96839fa</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="uuid">4bf23f6c-34b4-4cec-923b-3cbbc96839fa</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/disk.config"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <alias name="ua-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-2"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <serial>ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d</serial>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:5e:76:38"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <target dev="tap3a3cdf50-43"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa/console.log" append="off"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-937200957-network", "vif_mac": "fa:16:3e:5e:76:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:06.040498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.042626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:06.042626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:06.043286 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.043668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '897ea652-5d54-5e55-b479-9438211867c0', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:06.046060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:06.059494 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.061561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.061760 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a3cdf50-43, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:06.062255 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a3cdf50-43, col_values=(('qos', UUID('3c26e5f5-b337-4dad-acad-4d4091ab8655')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:06.062516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a3cdf50-43, col_values=(('external_ids', {'iface-id': '3a3cdf50-439e-4f79-825f-6ff30b237db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:76:38', 'vm-uuid': '4bf23f6c-34b4-4cec-923b-3cbbc96839fa'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:06.066256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:06.079423 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.080620 np0000003683 nova-compute[98991]: INFO os_vif [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43')
Jun 26 02:44:06.097350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:44:06.097614 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:44:06.098980 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if device paths {'sdj', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:44:06.112303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Device paths {'sdj', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:44:06.112927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:44:06.123874 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.159066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260]
Jun 26 02:44:06.159066 np0000003683 nova-compute[98991]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:06.159066 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.179528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.192639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.233980 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260]
Jun 26 02:44:06.233980 np0000003683 nova-compute[98991]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:06.233980 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.256647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.257089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:06.257802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== disconnect_volume: return (377ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:06.257802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:44:06.266250 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start _get_guest_xml network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2295e721-a68b-46a7-ac00-22e4c5e67d58', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'ed3b38c4-c012-4f44-8801-8bc21e30c0c5', 'attached_at': '', 'detached_at': '', 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'serial': '685e3e90-c453-499b-9807-d2eb1d4b3182'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:06.270400 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:06.273395 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-54203554', uuid='ed3b38c4-c012-4f44-8801-8bc21e30c0c5'), owner=OwnerMeta(userid='b19b282009bd41bd924982574984e524', username='tempest-AttachVolumeTestJSON-391502958-project-member', projectid='f149d284f0d24070afe71cccd4c0c744', projectname='tempest-AttachVolumeTestJSON-391502958'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441846.2730033) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:06.274891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:06.275318 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:06.276089 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:06.276296 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:06.277403 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:06.277788 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:06.277964 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:06.278090 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:06.278251 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:06.278379 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:06.278506 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:06.278725 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:06.278864 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:06.279003 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:06.279143 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:06.279280 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:06.279449 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:06.530862 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.570188 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.573188 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.631003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.656994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.706414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:06.706621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:06.706776 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:a5:10:27, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:06.707425 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Using config drive
Jun 26 02:44:06.727538 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.737799 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:06.782987 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:06.798566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:06.885855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:06.887420 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:06.887783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:06.888432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:06.888926 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:44:06.889440 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:06.889678 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:06.890089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:06.890455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:44:06.905599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:06.905599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:06.905599 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:06.906054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:06.906422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:06.906712 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:06.921133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:06.921133 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.921969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:06.921969 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182] added
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:06.935218 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.936100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:06.936100 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:06.936100 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182] added
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:06.938470 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:06.938737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:06.938961 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:06.939055 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:07.062879 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.214997 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:07.389387 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.394169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.414046 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.421963 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Creating config drive at /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.config
Jun 26 02:44:07.427141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4w13xk5p {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:07.452746 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ca534d8d-574b-4772-8e7c-e2ff641d3e24 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:07.454005 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 8c307448-2d6a-4df3-b427-af9db2c9378a due to new event <LifecycleEvent: 1782441847.453531, 8c307448-2d6a-4df3-b427-af9db2c9378a => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:44:07.454783 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441847.453531, 8c307448-2d6a-4df3-b427-af9db2c9378a => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:07.454783 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Resumed (Lifecycle Event)
Jun 26 02:44:07.461170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.481177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4w13xk5p" returned: 0 in 0.054s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:07.568744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:07.569420 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:07.569861 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:07.570056 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:07.570215 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:07.570435 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ffc7938c-8ed8-437f-9020-862d1d7cfe76 req-7daceacd-93e6-4cfc-8072-5228e0277b77 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state None.
Jun 26 02:44:07.609864 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:07.609864 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:07.609864 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] No VIF found with MAC fa:16:3e:5e:76:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:07.610243 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Using config drive
Jun 26 02:44:07.651369 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:07.707020 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:44:07.939900 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:07.940645 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:07.956296 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:07.964712 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:07.970652 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:07.974945 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:07.983993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:07.993658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.004767 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.005001 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.015584 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.015848 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:08.067930 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260]
Jun 26 02:44:08.067930 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:08.067930 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:08.069963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260]
Jun 26 02:44:08.069963 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:08.069963 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:08.087922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:08.089400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:08.097075 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0025347249998048937 future=<Future at 0x72e27c2aa270 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:08.097075 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:08.097075 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.7212544139999864 future=<Future at 0x72e27c2b3500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:08.097075 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.7211751959998765 future=<Future at 0x72e27c2b3500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.108348 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.109267 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:08.109773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:08.110682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:08.111093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('8', '-', '-', 0) found on session 50 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:08.111217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.115742 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:08.118714 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:08.119045 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:08.119179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:08.120312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('15', '-', '-', 0) found on session 51 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:08.120469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:08.130239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 50 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:08.130239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:08.147014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 51 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:08.147014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:08.192301 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:08.192301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:08.192593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:08.192655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:08.192818 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:08.192958 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9d2ad19b-4647-4170-bf7c-4d803412f14e req-7e86bd2f-3930-42a4-b749-b4ce9a8423f6 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state active and task_state rescuing.
Jun 26 02:44:08.272424 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance destroyed successfully.
Jun 26 02:44:08.273638 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'numa_topology' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:08.483206 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441848.4829035, 8c307448-2d6a-4df3-b427-af9db2c9378a => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:08.483798 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Started (Lifecycle Event)
Jun 26 02:44:08.541568 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.583814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.589785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.695641 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.732817 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.733908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.752365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.759130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.779806 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attempting a stable device rescue
Jun 26 02:44:08.822514 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.906023 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:44:08.907743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:44:08.920305 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:44:08.920735 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Creating image(s)
Jun 26 02:44:08.921710 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:08.921944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:08.927067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:08.927067 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'trusted_certs' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:08.959704 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.974955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.983164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:08.985768 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:08.993452 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:09.012403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:09.012403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:09.012403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:09.012403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:09.012403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:09.013558 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c2224c60-5436-4153-ae79-7e69e96024bf req-46204513-633f-477a-b47f-a768f103e884 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state active and task_state resize_finish.
Jun 26 02:44:09.335768 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Unrescuing
Jun 26 02:44:09.335768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:09.335768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:09.335768 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:09.429852 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:09.430175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:09.430672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:09.496999 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:44:09.497640 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999768668999877 future=<Future at 0x72e27c19fbc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:09.661875 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:09.661875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:09.661875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:09.663636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:09.663636 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:09.663636 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d1abaa15-1ca5-4486-80bd-19f87f63f607 req-915c52cf-ee3b-48c4-a17d-96475a301ba8 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:09.817847 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005731319999995321 future=<Future at 0x72e27c2b3500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:09.818801 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-f2ed41e7-ec54-4da4-a539-1d296cb9d2a5 None None] Emitting event <LifecycleEvent: 1782441834.8170683, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:09.818942 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f2ed41e7-ec54-4da4-a539-1d296cb9d2a5 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Stopped (Lifecycle Event)
Jun 26 02:44:09.820203 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:09.820203 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.096363862000089 future=<Future at 0x72e27c4d1d90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:09.820203 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.096230233999904 future=<Future at 0x72e27c4d1d90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:09.837652 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:09.926228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found WWN 33000000071d62c9d for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:44:09.926228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:09.926228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000071d62c9d', 'path': '/dev/dm-0', 'multipath_id': '33000000071d62c9d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:09.926228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000071d62c9d', 'path': '/dev/dm-0', 'multipath_id': '33000000071d62c9d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:44:10.096524 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441850.095545, 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:10.096524 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] VM Started (Lifecycle Event)
Jun 26 02:44:10.199885 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:10.199885 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance running successfully.
Jun 26 02:44:10.199885 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Failed to set time: agent not configured {{(pid=98991) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 26 02:44:10.199885 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2c0acfd3-a81f-48e5-85a2-357a2bcd1332 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] finish_migration finished successfully. {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}}
Jun 26 02:44:10.256873 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:10.293683 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:10.295614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:10.295614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:10.295614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:10.295614 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:10.295614 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9c21de1e-2acc-410d-8bd1-d44a5f0bc931 req-070d1233-f72e-4d0b-9d19-50dc14681806 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state active and task_state rescuing.
Jun 26 02:44:10.323010 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f2ed41e7-ec54-4da4-a539-1d296cb9d2a5 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:10.436791 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:10.437077 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:10.440629 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:10.441550 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'pci_devices' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:10.448117 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating instance_info_cache with network_info: [{"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:10.599899 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:10.605383 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441850.6050394, 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:10.605604 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] VM Paused (Lifecycle Event)
Jun 26 02:44:10.673111 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:10.676229 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:10.676761 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:10.772642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:10.773204 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] 01d884ac-4414-4b42-a4b4-9341f5336fb1 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:44:10.774246 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:44:10.774876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.part /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:10.953633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-8c307448-2d6a-4df3-b427-af9db2c9378a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:10.954566 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'flavor' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:10.956333 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <uuid>ed3b38c4-c012-4f44-8801-8bc21e30c0c5</uuid>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <name>instance-00000011</name>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeTestJSON-server-54203554</nova:name>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:06</nova:creationTime>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:user uuid="b19b282009bd41bd924982574984e524">tempest-AttachVolumeTestJSON-391502958-project-member</nova:user>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:project uuid="f149d284f0d24070afe71cccd4c0c744">tempest-AttachVolumeTestJSON-391502958</nova:project>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         <nova:port uuid="a0a37bc6-1dae-4326-bcc9-fae26e81828a">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="serial">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="uuid">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <alias name="ua-685e3e90-c453-499b-9807-d2eb1d4b3182"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <serial>685e3e90-c453-499b-9807-d2eb1d4b3182</serial>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:39:e3:37"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <target dev="tapa0a37bc6-1d"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/console.log" append="off"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:10.957882 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:10.960263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:10.983303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.part /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.converted" returned: 0 in 0.208s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:10.997611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.063533 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.090738 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.092912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.119599 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:11.123005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6.converted --force-share --output=json" returned: 0 in 0.125s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.124954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.694s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:11.131249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:11.137358 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:11.140794 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:11.141269 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:11.141623 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:11.141712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:11.141982 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:11.142092 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c48c9cbf-532e-4d73-9873-c1fa12de19b9 req-534819ad-59a2-430b-9622-55ccf25d5474 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received unexpected event network-vif-plugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with vm_state resized and task_state None.
Jun 26 02:44:11.145033 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:11.151058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:11.151882 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:11.152168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:11.153716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:11.154637 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:11.158390 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:11.162330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.198655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.199715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:44:11.203668 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:11.254856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6 --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.255254 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6,backing_fmt=raw /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.311799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8da14a9a8d617fed25c3fdd42f461ebc0c054e6,backing_fmt=raw /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.rescue" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.312566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "a8da14a9a8d617fed25c3fdd42f461ebc0c054e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:11.312848 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'migration_context' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:11.411120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:11.411374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:11.489135 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.498182 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.517684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.634799 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.637715 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:44:11.638130 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441851.6378725, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:11.638262 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Resumed (Lifecycle Event)
Jun 26 02:44:11.660517 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.665139 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:44:11.680009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:11.706381 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:11.706807 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.763171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:11.763371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:11.764320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:11.764536 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:11.764729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:11.764910 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-28e2e2a1-853d-4ad2-94a1-8cc84f3c5017 req-cd790c0a-8653-4ad6-a3ce-f0ea13f25273 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:11.816013 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:11.816183 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:11.819714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start _get_guest_xml network_info=[{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "vif_mac": "fa:16:3e:3c:62:40"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01d884ac-4414-4b42-a4b4-9341f5336fb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '02e6f3f4-a276-43af-8e02-3af00ee2059f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '110dbeda-4ed0-4234-863e-7441034d8449', 'attached_at': '', 'detached_at': '', 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'serial': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:11.820387 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'resources' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:11.826190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.119s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.827114 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:11.827114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:11.855499 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance destroyed successfully.
Jun 26 02:44:11.856540 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:11.915696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:44:11.940659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:11.941123 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Cannot resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:11.941373 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'migration_context' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:12.068451 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abf23ebd-c6a7-49d1-a26c-68bb7c54bd89 req-e6ef1006-3db7-474d-8ca2-1e71497362c9 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:12.069235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf23ebd-c6a7-49d1-a26c-68bb7c54bd89 req-e6ef1006-3db7-474d-8ca2-1e71497362c9 service nova] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:12.069584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf23ebd-c6a7-49d1-a26c-68bb7c54bd89 req-e6ef1006-3db7-474d-8ca2-1e71497362c9 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:12.069832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abf23ebd-c6a7-49d1-a26c-68bb7c54bd89 req-e6ef1006-3db7-474d-8ca2-1e71497362c9 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:12.070032 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abf23ebd-c6a7-49d1-a26c-68bb7c54bd89 req-e6ef1006-3db7-474d-8ca2-1e71497362c9 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Processing event network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:44:12.070913 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:12.075433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:44:12.079600 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance spawned successfully.
Jun 26 02:44:12.080195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:44:12.105264 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:12.105370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:12.106765 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Going to confirm migration 2 {{(pid=98991) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 26 02:44:12.142533 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:12.146061 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:12.229365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:12.229692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:12.233251 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:44:12.233462 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Claim successful on node np0000003683
Jun 26 02:44:12.351007 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:12.353230 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:12.354805 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1987187591', uuid='110dbeda-4ed0-4234-863e-7441034d8449'), owner=OwnerMeta(userid='ee6c50f6bfbb4d348c72bbd8356447a9', username='tempest-ServerStableDeviceRescueTest-502021662-project-member', projectid='0aeb950792b84ac38e258cbabc9785b2', projectname='tempest-ServerStableDeviceRescueTest-502021662'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "vif_mac": "fa:16:3e:3c:62:40"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441852.354317) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:12.359957 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<8c307448-2d6a-4df3-b427-af9db2c9378a> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:12.360389 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:12.360923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:12.365922 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:12.366189 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:12.367434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:12.367955 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:12.368182 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:12.368326 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:12.370695 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:12.370892 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:12.371011 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:12.371775 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:12.371905 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:12.372015 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:12.372117 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:12.372230 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:12.372445 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'vcpu_model' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:12.443452 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:12.444473 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:12.444776 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:12.445448 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:12.445786 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:12.446202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.446559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:12.446912 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:12.448090 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.448279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e570000e-ebe4-53e7-a767-d8252633b11d', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:12.451060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.452051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:12.465542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.469506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.469784 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a37bc6-1d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:12.470232 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0a37bc6-1d, col_values=(('qos', UUID('3b6c2f29-3880-489c-aa2d-33f3de975e07')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:12.470791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0a37bc6-1d, col_values=(('external_ids', {'iface-id': 'a0a37bc6-1dae-4326-bcc9-fae26e81828a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:e3:37', 'vm-uuid': 'ed3b38c4-c012-4f44-8801-8bc21e30c0c5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:12.471921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.473178 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:12.491936 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:12.492565 np0000003683 nova-compute[98991]: INFO os_vif [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:44:12.500332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:12.590021 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.590299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.592736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.592736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.592736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.592736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:12.621932 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:12.649308 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441852.6489913, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:12.649797 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Started (Lifecycle Event)
Jun 26 02:44:12.785939 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:12.786257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:12.786430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquired lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:12.789048 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:12.789314 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'info_cache' on Instance uuid 4bf23f6c-34b4-4cec-923b-3cbbc96839fa {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:12.877238 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:12.888780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:12.987387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:12.987935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:12.988246 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:12.988921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:12.989340 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:44:12.992822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:12.993068 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:12.996715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:12.997168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:44:13.012745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:13.013353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:13.014220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:13.014459 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:13.015185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:13.015403 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:13.029460 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:13.034764 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:13.052424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:13.059673 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:13.077783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:13.081749 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] HCTL ('9', '0', '0', 0) found on session 46 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.083059 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:13.083460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:13.084014 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:13.084567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:13.084567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:13.086229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] HCTL ('10', '0', '0', 0) found on session 47 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:13.086297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:13.097615 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Took 10.58 seconds to spawn the instance on the hypervisor.
Jun 26 02:44:13.097854 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:13.100244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching for a device in session 46 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:13.100450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:13.102660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Searching for a device in session 47 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:13.102871 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:13.155791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:13.157433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:13.251062 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.295909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.297781 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.376812 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.412941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.434897 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.441096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.489647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.596358 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:13.596692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:13.597962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:13.600019 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:13.603090 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:13.604150 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1b06b8ea-05de-46ba-b469-5b14da96865f req-2cd405fb-65bc-4092-b6a0-64ba699d7786 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state stopped and task_state powering-on.
Jun 26 02:44:13.618520 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Took 21.02 seconds to build instance.
Jun 26 02:44:13.630595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.660558 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999679213000036 future=<Future at 0x72e27c19f290 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:13.661136 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441853.6607087, 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:13.661199 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] VM Resumed (Lifecycle Event)
Jun 26 02:44:13.801266 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:13.843988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.851468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.860011 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.867968 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:13.869510 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:13.874748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:13.876381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:13.876617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:13.876781 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:13.876865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:13.877164 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:13.877220 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:13.877399 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:13.877647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:13.877743 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:13.877960 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:13.878243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:13.878243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:13.878372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:13.880322 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:13.882547 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ea4ce4ab-9c0f-4fa1-9480-7eef07ba3c1f req-cbee8d56-f43b-4a15-bd3f-88b4e12c00c1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received unexpected event network-vif-plugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:13.887377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:13.892227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:14.017048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:44:14.020030 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:14.020189 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:14.084680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:14.121660 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cde7b9bd-63fc-416b-9f8d-b68e9699e8bf tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.535s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:14.153497 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:14.153703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:14.153851 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:14.153975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:14.154415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] No waiting events found dispatching network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:14.154538 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ba911d56-fa7e-483d-bdfe-95c8e36dd96c req-474a7cf3-32e5-4e22-9cac-97df403eea99 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received unexpected event network-vif-plugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 for instance with vm_state active and task_state None.
Jun 26 02:44:14.164831 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:14.169703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:14.277408 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:14.456929 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [{"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:14.515630 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:14.519263 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d7181074-ca08-42e6-97c1-23cc0311b493 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:14.520189 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance rebooted successfully.
Jun 26 02:44:14.525015 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:14.673687 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for ed3b38c4-c012-4f44-8801-8bc21e30c0c5 due to new event <LifecycleEvent: 1782441854.673239, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:44:14.674141 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441854.673239, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:14.674141 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Resumed (Lifecycle Event)
Jun 26 02:44:14.916824 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00035808799998449103 future=<Future at 0x72e27c4d1d90 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:14.916969 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:14.917025 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=9.580055612000024 future=<Future at 0x72e27c19fbc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:14.917075 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=9.579986282999926 future=<Future at 0x72e27c19fbc0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:14.959722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Releasing lock "refresh_cache-4bf23f6c-34b4-4cec-923b-3cbbc96839fa" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:14.960506 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'migration_context' on Instance uuid 4bf23f6c-34b4-4cec-923b-3cbbc96839fa {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:15.032008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.802s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:15.032564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:15.036471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.538s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:15.041095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Found WWN 330000000329ddc43 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:44:15.041611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:15.041869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] <== connect_volume: return (2049ms) {'type': 'block', 'scsi_wwn': '330000000329ddc43', 'path': '/dev/dm-1', 'multipath_id': '330000000329ddc43'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:15.042023 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000329ddc43', 'path': '/dev/dm-1', 'multipath_id': '330000000329ddc43'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:44:15.045646 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:44:15.046628 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Claim successful on node np0000003683
Jun 26 02:44:15.178825 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:15.180351 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:15.463044 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Object Instance<4bf23f6c-34b4-4cec-923b-3cbbc96839fa> lazy-loaded attributes: info_cache,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:15.464383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:15.544339 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:15.544611 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:15.545554 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:15.545889 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:15.556680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987187591',display_name='tempest-ServerStableDeviceRescueTest-server-1987187591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverstabledevicerescuetest-server-1987187591',id=16,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBMJg8UMI308yfJ7kxj58PBigfJuGmKE/LcCk0a0HVYoeNNxvQ4y2i2EGyXOLTXdpZWFnK2zxrlWkc5M6vsfhYXZfZC8hz+K4lTbmmyph4/VA0TVytbXE61gUItwip0Q==',key_name='tempest-keypair-1504413044',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:05Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aeb950792b84ac38e258cbabc9785b2',ramdisk_id='',reservation_id='r-mkw01xlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-502021662',owner_user_name='tempest-ServerStableDeviceRescueTest-502021662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c50f6bfbb4d348c72bbd8356447a9',uuid=110dbeda-4ed0-4234-863e-7441034d8449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "vif_mac": "fa:16:3e:3c:62:40"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:15.556941 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converting VIF {"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "vif_mac": "fa:16:3e:3c:62:40"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:15.557835 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:15.558705 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'pci_devices' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:15.635242 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13af0bfb96bf40179144f66af7baeed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419e029cdd744c1598f7a9d2bcc52340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:15.683097 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 26 02:44:15.685422 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:15.685688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:15.685889 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:15.686049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:15.686202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:15.686614 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ec94a1c6-84db-4066-b37c-8455b424ed28 req-d0fbe0a6-4cdd-45d9-94b4-f25874a86ffe service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state stopped and task_state powering-on.
Jun 26 02:44:15.686773 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441855.6865494, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:15.686942 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Started (Lifecycle Event)
Jun 26 02:44:16.046431 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:16.046651 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:16.046840 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:16.047424 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:39:e3:37, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:16.047767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-84f8339b-9a3b-4973-9924-c6635c710a28 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:16.049090 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:16.060948 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <uuid>110dbeda-4ed0-4234-863e-7441034d8449</uuid>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <name>instance-00000010</name>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1987187591</nova:name>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:12</nova:creationTime>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:user uuid="ee6c50f6bfbb4d348c72bbd8356447a9">tempest-ServerStableDeviceRescueTest-502021662-project-member</nova:user>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:project uuid="0aeb950792b84ac38e258cbabc9785b2">tempest-ServerStableDeviceRescueTest-502021662</nova:project>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         <nova:port uuid="fbe3af3d-b581-4979-9370-666943905e41">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="serial">110dbeda-4ed0-4234-863e-7441034d8449</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="uuid">110dbeda-4ed0-4234-863e-7441034d8449</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <alias name="ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <serial>0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6</serial>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.rescue"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <target dev="vdc" bus="virtio"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <boot order="1"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:3c:62:40"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <target dev="tapfbe3af3d-b5"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/console.log" append="off"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:16.066926 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:16.098072 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance destroyed successfully.
Jun 26 02:44:16.173401 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Successfully created port: 842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:16.193822 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:16.204759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:16.296567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-changed-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:16.296695 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Refreshing instance network info cache due to event network-changed-3439bbb0-3253-40bb-bd4e-e0859ce37da3. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:16.298452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] Acquiring lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:16.298613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] Acquired lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:16.301243 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Refreshing network info cache for port 3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:16.561563 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:16.635963 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:16.711051 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 8c307448-2d6a-4df3-b427-af9db2c9378a due to new event <LifecycleEvent: 1782441856.7107723, 8c307448-2d6a-4df3-b427-af9db2c9378a => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:44:16.711528 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441856.7107723, 8c307448-2d6a-4df3-b427-af9db2c9378a => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:16.711528 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Resumed (Lifecycle Event)
Jun 26 02:44:16.807944 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:16.830708 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:16.830950 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:16.963454 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Successfully updated port: 842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:17.155567 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:17.213539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:17.215122 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:17.298858 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Updated VIF entry in instance network info cache for port 3439bbb0-3253-40bb-bd4e-e0859ce37da3. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:17.299163 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Updating instance_info_cache with network_info: [{"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:17.333658 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:17.355968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:17.356185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:17.466375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:17.467492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:17.467492 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:17.474127 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:17.571965 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:17.573146 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:17.573414 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Creating image(s)
Jun 26 02:44:17.573956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:17.574139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:17.576090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:17.577652 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:17.581396 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:17.582519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:17.633241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:17.633241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:17.633241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:17.633241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:17.633241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] No VIF found with MAC fa:16:3e:3c:62:40, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:17.637769 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Using config drive
Jun 26 02:44:17.668557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:17.668922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:17.669314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:17.669817 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:17.672643 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:17.673025 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:17.682623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:17.718296 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441857.7173762, 8c307448-2d6a-4df3-b427-af9db2c9378a => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:17.718296 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Started (Lifecycle Event)
Jun 26 02:44:17.754501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.081s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:17.754995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:17.799986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk 1073741824" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:17.800366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:17.800711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:17.802091 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-943bf99a-a919-4495-94b7-c1112d78e54a req-20c24d74-8bc9-4acc-b623-e3634aaa536d service nova] Releasing lock "refresh_cache-8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:17.841275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.805s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:17.842044 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.377s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:17.843584 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:17.860938 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:44:17.883308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:17.883735 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:17.884150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:18.095929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:18.097990 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Cannot resize image /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:18.098195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:18.098336 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Ensure instance console log exists: /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:18.098590 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:18.098758 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:18.098883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:18.141342 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'ec2_ids' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:18.155357 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:18.220950 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:18.223071 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:18.311018 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:18.355442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:18.357557 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:18.357557 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:18.357557 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:18.381338 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-changed-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:18.382460 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Refreshing instance network info cache due to event network-changed-842beb6d-eeb6-411e-b19a-827e327fe91e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:18.382708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] Acquiring lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:18.468040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:18.511910 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a90f9b496904250a9167c7761ad6f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac7218fd5ea43579f052f1bd83fe39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:18.518176 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updating instance_info_cache with network_info: [{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:18.647878 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:18.647878 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'keypairs' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:18.857707 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:19.020875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:19.021101 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Instance network_info: |[{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:19.021361 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] Acquired lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:19.023332 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Start _get_guest_xml network_info=[{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:19.023684 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Refreshing network info cache for port 842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:19.027473 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:19.029081 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-390303236', uuid='159e9cea-d640-42ca-b93d-9f5b3cfc4ff3'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441859.028648) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:19.030398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:19.030851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:19.032099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:19.032339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:19.033753 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:19.034045 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:19.034254 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:19.034606 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:19.035081 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:19.035247 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:19.035394 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:19.035641 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:19.035791 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:19.035955 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:19.036103 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:19.036274 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:19.058251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-390303236',display_name='tempest-TestEncryptedCinderVolumes-server-390303236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-390303236',id=23,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHlHTHBjIRmrJVZT5c/iIr5Uik/qUpPDtX6y4zCZeJaCsJqWX2ymyj6sAmU3fDbXK6AqGbdUVz1sohmpQ5Keoeh01zd07VEhRV+NGqsDElmhvWmak0PAYCxSmCzHQY4g==',key_name='tempest-keypair-698977925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-5ptk2w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=159e9cea-d640-42ca-b93d-9f5b3cfc4ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:19.058518 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:19.059499 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:19.059967 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'pci_devices' on Instance uuid 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:19.071466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:19.071773 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:19.084025 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Successfully created port: ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:19.152546 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:19.155499 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:19.301057 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Creating config drive at /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config.rescue
Jun 26 02:44:19.306210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5euta82x {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:19.356743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5euta82x" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:19.363155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:19.527538 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <uuid>159e9cea-d640-42ca-b93d-9f5b3cfc4ff3</uuid>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <name>instance-00000017</name>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-390303236</nova:name>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:19</nova:creationTime>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         <nova:port uuid="842beb6d-eeb6-411e-b19a-827e327fe91e">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="serial">159e9cea-d640-42ca-b93d-9f5b3cfc4ff3</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="uuid">159e9cea-d640-42ca-b93d-9f5b3cfc4ff3</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.config"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c9:10:d3"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <target dev="tap842beb6d-ee"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/console.log" append="off"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:19.563207 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Preparing to wait for external event network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-390303236',display_name='tempest-TestEncryptedCinderVolumes-server-390303236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-390303236',id=23,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHlHTHBjIRmrJVZT5c/iIr5Uik/qUpPDtX6y4zCZeJaCsJqWX2ymyj6sAmU3fDbXK6AqGbdUVz1sohmpQ5Keoeh01zd07VEhRV+NGqsDElmhvWmak0PAYCxSmCzHQY4g==',key_name='tempest-keypair-698977925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-5ptk2w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=159e9cea-d640-42ca-b93d-9f5b3cfc4ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:19.569161 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.571560 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:19.571560 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:19.575681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.575681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '138d20ae-dd16-56c8-8819-d6eda030c35e', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:19.575681 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:19.582047 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:19.590694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.590694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap842beb6d-ee, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:19.590694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap842beb6d-ee, col_values=(('qos', UUID('3cdcc273-c8dd-4cdf-bd4e-7e08df9965f9')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:19.590694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap842beb6d-ee, col_values=(('external_ids', {'iface-id': '842beb6d-eeb6-411e-b19a-827e327fe91e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:10:d3', 'vm-uuid': '159e9cea-d640-42ca-b93d-9f5b3cfc4ff3'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:19.593668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.595142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:19.609200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.609200 np0000003683 nova-compute[98991]: INFO os_vif [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee')
Jun 26 02:44:19.633673 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Successfully updated port: ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:19.689516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-changed-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:19.689516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Refreshing instance network info cache due to event network-changed-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:19.689516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] Acquiring lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:19.689516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] Acquired lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:19.689770 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Refreshing network info cache for port ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:19.832167 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:19.846989 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.889872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.890962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:19.991718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.043676 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updated VIF entry in instance network info cache for port 842beb6d-eeb6-411e-b19a-827e327fe91e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:20.044064 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updating instance_info_cache with network_info: [{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:20.085736 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:20.085998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:20.086254 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:20.086650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:20.088373 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:20.088373 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9e8b2db3-a058-4cb4-9fac-c500fcc8fbca req-c41f689b-ca10-488c-8e6f-5f82da98d40e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state active and task_state rescuing.
Jun 26 02:44:20.137734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:20.197820 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:20.199243 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.206521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.210137 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.237957 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.243714 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.286164 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:20.378236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:20.380428 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:20.380428 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Creating image(s)
Jun 26 02:44:20.380924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:20.381314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:20.383486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:20.383486 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:20.386358 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:20.390353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:20.455089 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:20.478841 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:20.482586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:20.482586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:20.482586 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:20.483451 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:20.483998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:20.548686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21099008-939f-40b8-91b1-db31d247e4fa req-f0e0723e-387b-4d30-a1e3-369eac8f6691 service nova] Releasing lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:20.582606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:20.583302 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:20.604418 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.134s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:20.607585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.758s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:20.614778 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:20.619358 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:44:20.621753 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Claim successful on node np0000003683
Jun 26 02:44:20.649104 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk 1073741824" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:20.649428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:20.649775 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:20.762760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.112s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:20.763825 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:20.763825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:20.809000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 110dbeda-4ed0-4234-863e-7441034d8449 due to new event <LifecycleEvent: 1782441860.8082924, 110dbeda-4ed0-4234-863e-7441034d8449 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:44:20.812019 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441860.8082924, 110dbeda-4ed0-4234-863e-7441034d8449 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:20.812115 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Resumed (Lifecycle Event)
Jun 26 02:44:20.816310 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2449e2e0-f846-436d-aeb4-50b03b45125a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:20.870648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:20.870903 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Cannot resize image /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:20.871195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:20.871335 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Ensure instance console log exists: /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:20.871704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:20.871948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:20.872101 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:20.958232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-868a0961-3bc3-4882-b042-343347e594ef req-1711d026-5f68-41b2-a481-333cfc1aff99 service nova] Releasing lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:20.958962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquired lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:20.959165 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:21.136000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:21.136162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:21.136323 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:c9:10:d3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:21.136970 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Using config drive
Jun 26 02:44:21.205155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:21.294291 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Deleted allocation for migration 64feb7b6-fbab-435a-869a-a84c6f610bbd
Jun 26 02:44:21.318902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:21.321053 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:21.533662 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:21.636539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:21.644932 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:21.768337 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:21.806559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b4142433-19f7-4d74-b3c1-32070365f4f0 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.701s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:21.830512 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441861.8301342, 110dbeda-4ed0-4234-863e-7441034d8449 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:21.830701 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Started (Lifecycle Event)
Jun 26 02:44:21.849011 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Creating config drive at /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.config
Jun 26 02:44:21.856933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpod7s8w4u {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:21.919006 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpod7s8w4u" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:21.996767 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updating instance_info_cache with network_info: [{"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:22.171979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:22.172373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:22.172591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:22.172704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:22.172842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:22.172954 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-6a571650-6222-4927-a031-bc5965e9c519 req-b92c5c2b-54c8-4c06-8528-7f3337c10f73 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:22.305591 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:22.305591 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:22.333713 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f58f1bdd-2f62-4ecf-ac7b-0c7cce7d09bc tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Get console output
Jun 26 02:44:22.337950 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:22.342322 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.345160 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:22.396859 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.430761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.436738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.443822 np0000003683 nova-compute[98991]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jun 26 02:44:22.500217 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Releasing lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:22.500459 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance network_info: |[{"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:22.503733 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Start _get_guest_xml network_info=[{"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:22.515856 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:22.517519 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1002734930', uuid='64f180a3-7b25-4094-bcd8-ee5c84773a01'), owner=OwnerMeta(userid='6a90f9b496904250a9167c7761ad6f7b', username='tempest-VolumesSnapshotTestJSON-670786988-project-member', projectid='bac7218fd5ea43579f052f1bd83fe39b', projectname='tempest-VolumesSnapshotTestJSON-670786988'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441862.5164206) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:22.518116 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.522792 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:22.522792 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:22.524304 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:22.524660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:22.526247 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:22.526849 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:22.526957 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:22.527074 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:22.527278 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:22.527421 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:22.528711 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:22.529094 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:22.529311 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:22.529541 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:22.532505 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:22.532505 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:22.544421 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1002734930',display_name='tempest-VolumesSnapshotTestJSON-instance-1002734930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1002734930',id=24,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINIwz/bwbpRwyfTyrZChQJd9pJdEhn1Rpzs/GCt8L6cAbFR13JmNPIeWhs39Vx0VcW5gwrZ1wQrTGULyylA3HjIi2PtegGXQjoXY341MTwFxt7kNJS6sIiXwFk9RHOAkw==',key_name='tempest-keypair-65515740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-hbht09fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=64f180a3-7b25-4094-bcd8-ee5c84773a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:22.544708 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:22.545789 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:22.546348 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'pci_devices' on Instance uuid 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:22.547743 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Unrescuing
Jun 26 02:44:22.548229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:22.548229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:22.548419 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:22.761603 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.763893 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.767700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.792155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:22.808198 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:22.847447 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:44:23.054950 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <uuid>64f180a3-7b25-4094-bcd8-ee5c84773a01</uuid>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <name>instance-00000018</name>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1002734930</nova:name>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:22</nova:creationTime>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:user uuid="6a90f9b496904250a9167c7761ad6f7b">tempest-VolumesSnapshotTestJSON-670786988-project-member</nova:user>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:project uuid="bac7218fd5ea43579f052f1bd83fe39b">tempest-VolumesSnapshotTestJSON-670786988</nova:project>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         <nova:port uuid="ed2ddd75-1e38-44e0-8e46-ee03d596a1cc">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="serial">64f180a3-7b25-4094-bcd8-ee5c84773a01</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="uuid">64f180a3-7b25-4094-bcd8-ee5c84773a01</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.config"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:5b:34:5d"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <target dev="taped2ddd75-1e"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/console.log" append="off"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Preparing to wait for external event network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:23.060366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1002734930',display_name='tempest-VolumesSnapshotTestJSON-instance-1002734930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1002734930',id=24,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINIwz/bwbpRwyfTyrZChQJd9pJdEhn1Rpzs/GCt8L6cAbFR13JmNPIeWhs39Vx0VcW5gwrZ1wQrTGULyylA3HjIi2PtegGXQjoXY341MTwFxt7kNJS6sIiXwFk9RHOAkw==',key_name='tempest-keypair-65515740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-hbht09fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=64f180a3-7b25-4094-bcd8-ee5c84773a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:23.064549 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba6ad7c4-57f5-54d0-aa20-af712849bfe3', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:23.066506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:23.068151 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:23.068671 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped2ddd75-1e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:23.068671 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped2ddd75-1e, col_values=(('qos', UUID('3d08d6bc-2cbc-4d9f-abbe-96dc6a7057df')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:23.069253 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped2ddd75-1e, col_values=(('external_ids', {'iface-id': 'ed2ddd75-1e38-44e0-8e46-ee03d596a1cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:34:5d', 'vm-uuid': '64f180a3-7b25-4094-bcd8-ee5c84773a01'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:23.070392 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:23.071443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:23.078803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:23.080038 np0000003683 nova-compute[98991]: INFO os_vif [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e')
Jun 26 02:44:23.267700 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441863.2673275, 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:23.267922 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] VM Started (Lifecycle Event)
Jun 26 02:44:23.314070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.712s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:23.314487 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:23.413808 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:23.562671 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:23.771102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:23.772878 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441863.772616, 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:23.773041 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] VM Paused (Lifecycle Event)
Jun 26 02:44:23.819990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:23.820883 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:23.821245 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:23.821589 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:23.929428 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549e56d3a63947e894b5d6d92dd4eafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb8ac3d99734c44bd220c90726dd72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:24.064941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:24.066038 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'flavor' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:24.248923 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:24.249298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:24.249433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:24.249647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:24.249767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Processing event network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:44:24.249881 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:24.250003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:24.250105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:24.250204 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:24.250305 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] No waiting events found dispatching network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:24.250439 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received unexpected event network-vif-plugged-842beb6d-eeb6-411e-b19a-827e327fe91e for instance with vm_state building and task_state spawning.
Jun 26 02:44:24.250515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-changed-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:24.250622 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing instance network info cache due to event network-changed-fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:24.250733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:24.251019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:24.251145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:24.251252 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing network info cache for port fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:24.255602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:44:24.261367 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Instance spawned successfully.
Jun 26 02:44:24.261869 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:44:24.275983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:24.277976 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441864.2777824, 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:24.278089 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] VM Resumed (Lifecycle Event)
Jun 26 02:44:24.324494 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:24.381559 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Successfully created port: dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:24.497933 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0008299650000935799 future=<Future at 0x72e27c19fbc0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:24.498081 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:24.498236 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.1619277839999995 future=<Future at 0x72e27c19f290 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:24.498341 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.1618069979999746 future=<Future at 0x72e27c19f290 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:24.498432 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:24.599445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:24.605446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:24.614154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:24.614154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:24.614154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No VIF found with MAC fa:16:3e:5b:34:5d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:24.614865 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Using config drive
Jun 26 02:44:24.627066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:24.667173 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:24.753130 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:24.770016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.770230 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.770731 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.771101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.771470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.771842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:24.783232 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:24.801554 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:24.831150 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:24.966721 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance destroyed successfully.
Jun 26 02:44:24.968221 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'numa_topology' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:25.068502 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Successfully updated port: dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:25.116858 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-changed-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:25.127041 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:25.129942 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Refreshing instance network info cache due to event network-changed-dfc941df-aa6d-462e-a829-5458ef1d90ca. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:25.130941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] Acquiring lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:25.131228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] Acquired lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:25.131363 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Refreshing network info cache for port dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:25.224276 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:25.285314 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Took 7.71 seconds to spawn the instance on the hypervisor.
Jun 26 02:44:25.285548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:25.299960 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Creating config drive at /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.config
Jun 26 02:44:25.304433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps8b7yf77 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:25.317276 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:44:25.327050 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999555362000137 future=<Future at 0x72e27c14f3e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:25.328149 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998459323000134 future=<Future at 0x72e27c14f3e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:25.329131 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.997487202999991 future=<Future at 0x72e27c14f3e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:25.364258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps8b7yf77" returned: 0 in 0.060s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:25.395980 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updated VIF entry in instance network info cache for port fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:25.396428 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:25.476622 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Object Instance<110dbeda-4ed0-4234-863e-7441034d8449> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:44:25.572308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:25.633958 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:25.691972 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:25.801777 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Took 13.63 seconds to build instance.
Jun 26 02:44:25.825367 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:25.845856 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:25.846917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:25.847116 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Creating image(s)
Jun 26 02:44:25.847531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:25.847731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:25.848206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:25.849630 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:25.852787 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:25.855867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:25.884200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:25.899629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:25.900022 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-changed-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:25.900147 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing instance network info cache due to event network-changed-fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:25.900375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquiring lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:25.900509 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Acquired lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:25.900710 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Refreshing network info cache for port fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:25.928986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:25.958662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:25.959017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:25.959359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:25.959803 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:25.962510 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:25.962874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:26.073918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:26.076532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:26.100197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.134557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk 1073741824" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:26.134783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.135206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:26.151496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.250132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:26.250742 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:26.251057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:26.274442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.279962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.284534 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.304666 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fe86d65-e284-4d43-92f9-327793adcd03 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.152s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.320815 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.328712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b240db46-0ed2-43a0-bdde-0b424b8d867b req-342bb7b4-3549-47e1-9a69-fad5a0863b49 service nova] Releasing lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:26.328712 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.329356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:26.329780 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:26.364001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:26.365577 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Cannot resize image /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:26.365577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:26.365577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Ensure instance console log exists: /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:26.365577 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:26.365577 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:26.365795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.398487 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:26.398487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:26.398487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:26.398487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.398944 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:26.399188 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:26.399437 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:26.399713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:26.399975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:26.400201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.400412 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:26.400652 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:44:26.400839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:26.401075 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:26.402203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:26.402203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:26.402203 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0780ada-7166-4d91-bd41-ec003fe11984 req-324e753a-2c6c-45d1-b7ce-44e63849f52b service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Processing event network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:44:26.409904 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:26.413621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.447557 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.449717 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.566930 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.638191 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.792203 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.795448 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.809075 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.836496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:26.856357 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:26.932648 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:27.037960 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updated VIF entry in instance network info cache for port fbe3af3d-b581-4979-9370-666943905e41. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:27.038450 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [{"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:27.130050 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:27.281091 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Updating instance_info_cache with network_info: [{"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:27.357045 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441867.356578, 64f180a3-7b25-4094-bcd8-ee5c84773a01 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:27.357660 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:27.357878 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] VM Started (Lifecycle Event)
Jun 26 02:44:27.366339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:44:27.371040 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance spawned successfully.
Jun 26 02:44:27.371463 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:44:27.386318 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9bb79d1c-da7f-4c0f-bb17-6428f42d9715 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:27.403969 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-changed-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:27.404125 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Refreshing instance network info cache due to event network-changed-842beb6d-eeb6-411e-b19a-827e327fe91e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:27.404388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] Acquiring lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:27.406985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] Acquired lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:27.407150 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Refreshing network info cache for port 842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:27.540731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4cd8587b-96ef-4348-b733-af6d8035d2ee req-704f66fc-f781-41db-a81e-a4c41adf5b1b service nova] Releasing lock "refresh_cache-110dbeda-4ed0-4234-863e-7441034d8449" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:27.783743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-716bc480-bbf9-4921-8f5e-d382bf7100ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:27.784030 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance network_info: |[{"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:27.787632 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Start _get_guest_xml network_info=[{"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:27.793087 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:27.794360 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1331979031', uuid='716bc480-bbf9-4921-8f5e-d382bf7100ed'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441867.7940073) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:27.796299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:27.796777 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:27.797740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:27.797912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:27.800080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:27.800443 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:27.800645 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:27.800766 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:27.801944 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:27.802114 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:27.802301 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:27.802679 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:27.802846 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:27.803020 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:27.803185 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:27.803360 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:27.816056 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1331979031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1331979031',id=25,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-3s3wi4xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:25Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=716bc480-bbf9-4921-8f5e-d382bf7100ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:27.816309 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:27.816972 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:27.817624 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid 716bc480-bbf9-4921-8f5e-d382bf7100ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:27.868798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:27.871934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:27.875986 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.876102 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.876342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.876641 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.876859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.877101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:27.909700 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:28.071253 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.221032 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <uuid>716bc480-bbf9-4921-8f5e-d382bf7100ed</uuid>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <name>instance-00000019</name>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1331979031</nova:name>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:27</nova:creationTime>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         <nova:port uuid="dfc941df-aa6d-462e-a829-5458ef1d90ca">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="serial">716bc480-bbf9-4921-8f5e-d382bf7100ed</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="uuid">716bc480-bbf9-4921-8f5e-d382bf7100ed</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.config"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:ec:51:26"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <target dev="tapdfc941df-aa"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/console.log" append="off"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Preparing to wait for external event network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1331979031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1331979031',id=25,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-3s3wi4xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:25Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=716bc480-bbf9-4921-8f5e-d382bf7100ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:28.322397 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:28.324623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.324623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:28.324793 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:28.326702 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.326939 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56dccb07-b754-5ef0-bc15-61d7ecf72514', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:28.330199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.331274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:28.333491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.333718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc941df-aa, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:28.334093 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfc941df-aa, col_values=(('qos', UUID('9fb9d6b9-eceb-49e7-91df-eba281255e58')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:28.334292 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfc941df-aa, col_values=(('external_ids', {'iface-id': 'dfc941df-aa6d-462e-a829-5458ef1d90ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:51:26', 'vm-uuid': '716bc480-bbf9-4921-8f5e-d382bf7100ed'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:28.337714 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.339316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:28.343705 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:28.345358 np0000003683 nova-compute[98991]: INFO os_vif [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa')
Jun 26 02:44:28.364938 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updated VIF entry in instance network info cache for port 842beb6d-eeb6-411e-b19a-827e327fe91e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:28.365688 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updating instance_info_cache with network_info: [{"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:28.374771 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:44:28.375022 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441868.3748565, 64f180a3-7b25-4094-bcd8-ee5c84773a01 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:28.375134 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] VM Paused (Lifecycle Event)
Jun 26 02:44:28.385611 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Took 8.01 seconds to spawn the instance on the hypervisor.
Jun 26 02:44:28.386169 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:28.501019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:28.501189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:28.502958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:28.503355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:28.503885 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] No waiting events found dispatching network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:28.504026 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received unexpected event network-vif-plugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc for instance with vm_state active and task_state None.
Jun 26 02:44:28.504142 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:28.504285 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:28.504402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:28.504508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:28.504646 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:28.504738 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state active and task_state None.
Jun 26 02:44:28.504832 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:28.504943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:28.505036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:28.505152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:28.505267 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:28.505369 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-724f9dd6-a062-432b-ae53-ced44ef314eb req-3d2db6e0-41f5-467f-a7a8-ec70f64a37da service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received unexpected event network-vif-plugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with vm_state active and task_state None.
Jun 26 02:44:28.868852 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd0bf6d1-e730-4094-85e1-e386bbcdf3e1 req-aef32dc8-1c4a-452a-9fc7-8eec31aa9a96 service nova] Releasing lock "refresh_cache-159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:28.877354 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:28.878970 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441868.8787262, 64f180a3-7b25-4094-bcd8-ee5c84773a01 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:28.879134 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] VM Resumed (Lifecycle Event)
Jun 26 02:44:28.897857 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Took 16.47 seconds to build instance.
Jun 26 02:44:29.381723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:29.383403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:29.402462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d18f55fd-58a9-4abb-8244-f39a14f1dd0e tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.991s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:29.468297 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:29.862747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:29.862915 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:29.863029 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:ec:51:26, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:29.863432 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Using config drive
Jun 26 02:44:29.886434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 110dbeda-4ed0-4234-863e-7441034d8449 due to new event <LifecycleEvent: 1782441869.886138, 110dbeda-4ed0-4234-863e-7441034d8449 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:44:29.886808 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441869.886138, 110dbeda-4ed0-4234-863e-7441034d8449 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:29.886936 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Resumed (Lifecycle Event)
Jun 26 02:44:29.943869 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-changed-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:29.944442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Refreshing instance network info cache due to event network-changed-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:29.944761 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] Acquiring lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:29.944925 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] Acquired lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:29.945091 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Refreshing network info cache for port ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:30.369289 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:30.390308 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:30.395001 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:30.447390 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:30.609699 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Creating config drive at /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.config
Jun 26 02:44:30.613971 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplfioiixg {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:30.668393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplfioiixg" returned: 0 in 0.054s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:30.879849 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:30.900030 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441870.8995779, 110dbeda-4ed0-4234-863e-7441034d8449 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:30.900167 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Started (Lifecycle Event)
Jun 26 02:44:31.092345 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updated VIF entry in instance network info cache for port ed2ddd75-1e38-44e0-8e46-ee03d596a1cc. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:44:31.093031 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updating instance_info_cache with network_info: [{"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:31.158862 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.201267 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.212940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:31.213197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:31.304398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.347865 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.349160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.403046 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:31.405404 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:31.595848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-019dc09e-732e-4e1d-a590-1a8f4a389cd7 req-55ca8e2c-e340-4dd8-93a5-d70216d16491 service nova] Releasing lock "refresh_cache-64f180a3-7b25-4094-bcd8-ee5c84773a01" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:31.640328 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:31.720255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:44:31.957208 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441871.9568663, 716bc480-bbf9-4921-8f5e-d382bf7100ed => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:31.957406 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] VM Started (Lifecycle Event)
Jun 26 02:44:31.997163 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:31.997386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:31.997510 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:31.997601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:31.997748 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] No event matching network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca in dict_keys([('network-vif-plugged', 'dfc941df-aa6d-462e-a829-5458ef1d90ca')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:44:31.998134 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received unexpected event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca for instance with vm_state building and task_state spawning.
Jun 26 02:44:31.998231 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:31.998396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:31.998588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:31.998707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:31.998808 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Processing event network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:44:31.998922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:31.999172 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:31.999290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:31.999602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:31.999602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:31.999842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] No waiting events found dispatching network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:31.999842 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7fa99f25-5329-40c8-942f-e645c89a7eee req-72019623-713d-42e0-9e2b-e0b4a0716362 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received unexpected event network-vif-plugged-dfc941df-aa6d-462e-a829-5458ef1d90ca for instance with vm_state building and task_state spawning.
Jun 26 02:44:32.003116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:44:32.005621 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance spawned successfully.
Jun 26 02:44:32.005621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:44:32.266427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:32.266427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:32.268799 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:44:32.269063 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Claim successful on node np0000003683
Jun 26 02:44:32.461545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:32.461545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:32.510406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.510582 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.510842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.511113 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.511443 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.511785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:32.963755 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:44:32.964075 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441872.9638472, 716bc480-bbf9-4921-8f5e-d382bf7100ed => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:32.964219 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] VM Paused (Lifecycle Event)
Jun 26 02:44:33.016076 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Took 7.17 seconds to spawn the instance on the hypervisor.
Jun 26 02:44:33.016217 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:33.340500 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:33.466671 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:33.468249 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441873.4680085, 716bc480-bbf9-4921-8f5e-d382bf7100ed => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:33.468346 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] VM Resumed (Lifecycle Event)
Jun 26 02:44:33.529843 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Took 15.17 seconds to build instance.
Jun 26 02:44:33.820518 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:33.820747 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:33.971295 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:33.972990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:34.031389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.675s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:34.323409 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:34.830146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.564s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:34.830745 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:35.336276 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:35.336433 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:35.336715 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:35.336946 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:35.349978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:35.411689 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6fcd542f6324e05858dfde03fffe2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80653f0bc8cd40e6a86e691a5024e36b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:35.803618 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Successfully created port: ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:35.839496 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:35.855050 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] instance snapshotting
Jun 26 02:44:35.956673 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Beginning live snapshot process
Jun 26 02:44:36.292816 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Successfully updated port: ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:36.344462 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:36.358937 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-changed-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:36.358937 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Refreshing instance network info cache due to event network-changed-ea5ff8aa-c316-4071-9066-3b91d59cb70b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:36.358937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] Acquiring lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:36.358937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] Acquired lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:36.358937 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Refreshing network info cache for port ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:36.642764 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:36.795335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:36.865504 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:36.930524 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:37.065402 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:37.353100 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:37.353896 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:37.354104 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Creating image(s)
Jun 26 02:44:37.354465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:37.354765 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:37.355242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:37.355836 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.358419 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.359544 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.469947 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.470427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.470842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:37.481018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:37.481853 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.485428 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.486250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.568014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7fa2cea7-291e-496d-900f-6e042eef3c75 req-b4f3be6a-0494-4e3a-a43e-ca093923e53e service nova] Releasing lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:37.568996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquired lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:37.569313 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:37.577891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.578332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.591414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.121s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.592510 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.640029 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk 1073741824" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.640732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:37.641049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.672678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.674420 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.678804 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:44:37.679904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.728157 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.728686 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:44:37.728978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.769020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.772525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033.delta 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:37.818404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033.delta 1073741824" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.819144 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 26 02:44:37.826385 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:37.826879 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Cannot resize image /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:44:37.827219 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:44:37.827383 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Ensure instance console log exists: /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:37.827682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:37.827874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:37.827999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:38.049717 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:44:38.051601 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 26 02:44:38.097061 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:44:38.097061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033.delta /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:38.155069 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:38.183504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033.delta /opt/stack/data/nova/instances/snapshots/tmpvtnk0zk5/410a07e3bbf74489aa5427ca78c48033" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:38.186315 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Snapshot extracted, beginning image upload
Jun 26 02:44:38.322838 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:38.340738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:38.439817 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Updating instance_info_cache with network_info: [{"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:38.942053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Releasing lock "refresh_cache-dfe60628-8b47-41d5-967c-678f2402aca5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:38.942372 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance network_info: |[{"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:38.944336 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Start _get_guest_xml network_info=[{"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:38.947200 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:38.948958 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-792633176', uuid='dfe60628-8b47-41d5-967c-678f2402aca5'), owner=OwnerMeta(userid='a6fcd542f6324e05858dfde03fffe2b4', username='tempest-VolumesAdminNegativeTest-405224716-project-member', projectid='80653f0bc8cd40e6a86e691a5024e36b', projectname='tempest-VolumesAdminNegativeTest-405224716'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441878.9484563) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:38.949917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:38.950331 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:38.951113 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:38.951311 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:38.952521 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:38.952984 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:38.953189 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:38.953308 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:38.953465 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:38.953654 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:38.953793 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:38.954016 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:38.954160 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:38.954320 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:38.954469 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:38.954981 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:38.972588 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-792633176',display_name='tempest-VolumesAdminNegativeTest-server-792633176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesadminnegativetest-server-792633176',id=26,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80653f0bc8cd40e6a86e691a5024e36b',ramdisk_id='',reservation_id='r-mdieiqy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405224716',owner_user_name='tempest-VolumesAdminNegativeTest-405224716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:36Z,user_data=None,user_id='a6fcd542f6324e05858dfde03fffe2b4',uuid=dfe60628-8b47-41d5-967c-678f2402aca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:38.972809 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converting VIF {"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:38.973801 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:38.974420 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lazy-loading 'pci_devices' on Instance uuid dfe60628-8b47-41d5-967c-678f2402aca5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <uuid>dfe60628-8b47-41d5-967c-678f2402aca5</uuid>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <name>instance-0000001a</name>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesAdminNegativeTest-server-792633176</nova:name>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:38</nova:creationTime>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:user uuid="a6fcd542f6324e05858dfde03fffe2b4">tempest-VolumesAdminNegativeTest-405224716-project-member</nova:user>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:project uuid="80653f0bc8cd40e6a86e691a5024e36b">tempest-VolumesAdminNegativeTest-405224716</nova:project>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         <nova:port uuid="ea5ff8aa-c316-4071-9066-3b91d59cb70b">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="serial">dfe60628-8b47-41d5-967c-678f2402aca5</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="uuid">dfe60628-8b47-41d5-967c-678f2402aca5</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.config"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:f7:a6:ef"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <target dev="tapea5ff8aa-c3"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/console.log" append="off"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:39.479757 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:39.481896 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Preparing to wait for external event network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:39.481896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:39.481896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:39.481896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:39.483053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-792633176',display_name='tempest-VolumesAdminNegativeTest-server-792633176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesadminnegativetest-server-792633176',id=26,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80653f0bc8cd40e6a86e691a5024e36b',ramdisk_id='',reservation_id='r-mdieiqy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405224716',owner_user_name='tempest-VolumesAdminNegativeTest-405224716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:36Z,user_data=None,user_id='a6fcd542f6324e05858dfde03fffe2b4',uuid=dfe60628-8b47-41d5-967c-678f2402aca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:39.483053 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converting VIF {"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:39.483524 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:39.483899 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:39.484372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:39.484886 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:39.485026 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:39.487884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:39.487884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e10cdf5b-455c-5ab5-b1bc-6526911e31c6', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:39.489399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:39.492555 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:39.494316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea5ff8aa-c3, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:39.494316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea5ff8aa-c3, col_values=(('qos', UUID('933f683a-529d-4446-8849-b45634311f77')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:39.494316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea5ff8aa-c3, col_values=(('external_ids', {'iface-id': 'ea5ff8aa-c316-4071-9066-3b91d59cb70b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:a6:ef', 'vm-uuid': 'dfe60628-8b47-41d5-967c-678f2402aca5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:39.496347 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:39.501802 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:39.503063 np0000003683 nova-compute[98991]: INFO os_vif [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3')
Jun 26 02:44:40.327120 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.000495020000016666 future=<Future at 0x72e27c14f3e0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:40.327291 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:40.623375 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Snapshot image upload complete
Jun 26 02:44:40.623955 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9dcf2a6c-cfba-42d2-b4b5-8e71982353fe tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Took 4.77 seconds to snapshot the instance on the hypervisor.
Jun 26 02:44:41.023138 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:41.023138 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:44:41.023138 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] No VIF found with MAC fa:16:3e:f7:a6:ef, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:44:41.023656 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Using config drive
Jun 26 02:44:41.530611 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:41.644347 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:41.691974 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Creating config drive at /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.config
Jun 26 02:44:41.695248 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv4fkmci3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:41.740607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv4fkmci3" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:42.175257 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.212977 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.219116 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.306667 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.470870 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-324fbff6-c9a9-4dd9-ac7d-b6e348f848ce req-a2b4241d-673e-48e8-a2a2-1f84aa885bc7 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:42.472997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-324fbff6-c9a9-4dd9-ac7d-b6e348f848ce req-a2b4241d-673e-48e8-a2a2-1f84aa885bc7 service nova] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:42.475078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-324fbff6-c9a9-4dd9-ac7d-b6e348f848ce req-a2b4241d-673e-48e8-a2a2-1f84aa885bc7 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:42.475078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-324fbff6-c9a9-4dd9-ac7d-b6e348f848ce req-a2b4241d-673e-48e8-a2a2-1f84aa885bc7 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:42.475078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-324fbff6-c9a9-4dd9-ac7d-b6e348f848ce req-a2b4241d-673e-48e8-a2a2-1f84aa885bc7 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Processing event network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:44:42.542175 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.546835 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.552077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:42.573944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:43.020173 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441883.019628, dfe60628-8b47-41d5-967c-678f2402aca5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:43.020620 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] VM Started (Lifecycle Event)
Jun 26 02:44:43.021766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:44:43.025741 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:44:43.031160 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance spawned successfully.
Jun 26 02:44:43.031160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:44:43.171087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:43.171375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:43.523254 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:43.527793 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.540556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:44:43.673607 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:44:43.758057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:43.758240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:43.758457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:43.758649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:43.758789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:43.761915 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Terminating instance
Jun 26 02:44:44.030453 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:44:44.030905 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441884.030513, dfe60628-8b47-41d5-967c-678f2402aca5 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:44.030905 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] VM Paused (Lifecycle Event)
Jun 26 02:44:44.044428 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Took 6.69 seconds to spawn the instance on the hypervisor.
Jun 26 02:44:44.045072 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:44.217321 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:44.217519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:44.220901 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:44:44.221112 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Claim successful on node np0000003683
Jun 26 02:44:44.265374 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:44:44.287540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.292751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.313241 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.427075 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.433281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.438653 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:44.438838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:44.439046 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:44.439202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:44.439516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:44.439741 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a6293cd-6d92-456c-9e01-95ec07068831 req-b6975e54-4095-403e-85c5-18918e07bae8 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:44.495511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.534236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:44.539452 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441884.5391533, dfe60628-8b47-41d5-967c-678f2402aca5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:44:44.539666 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] VM Resumed (Lifecycle Event)
Jun 26 02:44:44.549547 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:44.549547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:44.549547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:44.549547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:44.549826 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] No waiting events found dispatching network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:44.549826 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f54f147b-610c-4a64-93d1-f23ebb66d972 req-dc70858d-6472-459e-a795-107ccce02a32 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received unexpected event network-vif-plugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b for instance with vm_state active and task_state None.
Jun 26 02:44:44.553533 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Took 12.33 seconds to build instance.
Jun 26 02:44:44.561895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.571330 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:44.592619 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Instance destroyed successfully.
Jun 26 02:44:44.592619 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'resources' on Instance uuid 4bf23f6c-34b4-4cec-923b-3cbbc96839fa {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:45.041839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:45.043774 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:44:45.055000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.842s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:45.093400 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2059963993',display_name='tempest-ServerActionsTestOtherA-server-2059963993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-2059963993',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:10Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-zdl36w87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=4bf23f6c-34b4-4cec-923b-3cbbc96839fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:44:45.093738 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "address": "fa:16:3e:5e:76:38", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3cdf50-43", "ovs_interfaceid": "3a3cdf50-439e-4f79-825f-6ff30b237db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:45.094551 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:45.094875 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:44:45.096952 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.097218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a3cdf50-43, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:45.099340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.099340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:45.100841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.101790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.101948 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c26e5f5-b337-4dad-acad-4d4091ab8655) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:45.102449 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.102927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:45.104669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:45.107237 np0000003683 nova-compute[98991]: INFO os_vif [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:38,bridge_name='br-int',has_traffic_filtering=True,id=3a3cdf50-439e-4f79-825f-6ff30b237db8,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3cdf50-43')
Jun 26 02:44:45.108598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:44:45.108953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:45.109506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:45.109879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:45.110206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:44:45.110339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:45.139453 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '51')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:44:45.139932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '48')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:45.140928 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d', '49')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:45.141973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c2ddd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:44:45.142686 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Removing multipathed devices sdb, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:44:45.142903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Flush multipath device 330000000320fefc6 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:44:45.194850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:45.253091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:45.310308 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if SCSI volumes sdb, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:44:45.310510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] SCSI volumes sdb, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:44:45.311826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Checking to see if device paths {'sdb', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:44:45.325539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Device paths {'sdb', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:44:45.325683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:44:45.338085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.380704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260]
Jun 26 02:44:45.380704 np0000003683 nova-compute[98991]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:45.380704 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.400831 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.411570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.448401 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260]
Jun 26 02:44:45.448401 np0000003683 nova-compute[98991]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:45.448401 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.468142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:45.468339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:45.468461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] <== disconnect_volume: return (358ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:45.468581 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:44:45.468872 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Deleting instance files /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa_del
Jun 26 02:44:45.469353 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Deletion of /opt/stack/data/nova/instances/4bf23f6c-34b4-4cec-923b-3cbbc96839fa_del complete
Jun 26 02:44:45.546224 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99972889500009 future=<Future at 0x72e27c33f710 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:45.547107 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998825774000125 future=<Future at 0x72e27c33f710 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:45.547214 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998684572000002 future=<Future at 0x72e27c33f710 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:45.802588 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:45.802588 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:45.975183 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Took 1.71 seconds to destroy the instance on the hypervisor.
Jun 26 02:44:45.975828 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:44:45.976031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:44:45.976153 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:44:45.976412 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:46.038335 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:46.304187 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:46.345107 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:46.346313 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:44:46.497605 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:46.497822 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] Acquiring lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:46.498096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:46.498252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:46.498635 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] No waiting events found dispatching network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:46.498792 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-unplugged-3a3cdf50-439e-4f79-825f-6ff30b237db8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:46.498936 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Received event network-vif-deleted-3a3cdf50-439e-4f79-825f-6ff30b237db8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:46.499101 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Neutron deleted interface 3a3cdf50-439e-4f79-825f-6ff30b237db8; detaching it from the instance and deleting it from the info cache
Jun 26 02:44:46.500434 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-740d3b57-d568-4fcf-946e-a394b7027993 req-1be97ec4-8d57-4162-937d-018345e66195 service nova] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Detach interface failed, port_id=3a3cdf50-439e-4f79-825f-6ff30b237db8, reason: Instance 4bf23f6c-34b4-4cec-923b-3cbbc96839fa could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:44:46.646338 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:46.810449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:46.810905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:44:46.889990 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:47.316308 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:44:47.316934 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:44:47.316934 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:47.317029 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:47.341259 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:47.341773 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:44:47.343836 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:47.383489 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549e56d3a63947e894b5d6d92dd4eafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb8ac3d99734c44bd220c90726dd72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:44:47.391762 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Took 1.42 seconds to deallocate network for instance.
Jun 26 02:44:47.788376 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Successfully created port: 0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:44:47.818830 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:44:47.847545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:47.847774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:47.847956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:47.848142 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:44:47.940851 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:44:47.941791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Deleting volume: ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:44:47.963131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:47.963391 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:47.963664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:47.963834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:47.963990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:47.965901 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Terminating instance
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Successfully updated port: 0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-changed-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Refreshing instance network info cache due to event network-changed-0582cc95-95b0-43fe-b8a4-737e34bdb240. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] Acquiring lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] Acquired lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Refreshing network info cache for port 0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:48.652079 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Deleted allocations for instance 4bf23f6c-34b4-4cec-923b-3cbbc96839fa
Jun 26 02:44:48.783532 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:48.797448 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:44:48.800300 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999762277999935 future=<Future at 0x72e27c2b32f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:48.801573 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Instance destroyed successfully.
Jun 26 02:44:48.801831 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lazy-loading 'resources' on Instance uuid dfe60628-8b47-41d5-967c-678f2402aca5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:48.828588 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Booting with volume-backed-image eb0918cd-17b7-4dc6-8a46-002286996c07 at /dev/vda
Jun 26 02:44:48.843762 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:48.886982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:44:48.890324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:48.904851 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:48.972143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:48.972764 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.050773 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:49.065112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.070207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.154730 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.155319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.246549 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.250980 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.304960 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-792633176',display_name='tempest-VolumesAdminNegativeTest-server-792633176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesadminnegativetest-server-792633176',id=26,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:44Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80653f0bc8cd40e6a86e691a5024e36b',ramdisk_id='',reservation_id='r-mdieiqy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-405224716',owner_user_name='tempest-VolumesAdminNegativeTest-405224716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:44Z,user_data=None,user_id='a6fcd542f6324e05858dfde03fffe2b4',uuid=dfe60628-8b47-41d5-967c-678f2402aca5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:44:49.305172 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converting VIF {"id": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "address": "fa:16:3e:f7:a6:ef", "network": {"id": "6bb95d1e-f71e-4e0d-bd0d-be5482065dcc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1462827431-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80653f0bc8cd40e6a86e691a5024e36b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ff8aa-c3", "ovs_interfaceid": "ea5ff8aa-c316-4071-9066-3b91d59cb70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:49.306143 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:49.306409 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:44:49.308119 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.308552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea5ff8aa-c3, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:49.310102 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.310855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:49.311861 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.312460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.312460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=933f683a-529d-4446-8849-b45634311f77) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:49.313698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.313847 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:49.314439 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:49.316494 np0000003683 nova-compute[98991]: INFO os_vif [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:ef,bridge_name='br-int',has_traffic_filtering=True,id=ea5ff8aa-c316-4071-9066-3b91d59cb70b,network=Network(6bb95d1e-f71e-4e0d-bd0d-be5482065dcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ff8aa-c3')
Jun 26 02:44:49.316845 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Deleting instance files /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5_del
Jun 26 02:44:49.317450 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Deletion of /opt/stack/data/nova/instances/dfe60628-8b47-41d5-967c-678f2402aca5_del complete
Jun 26 02:44:49.330200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.330811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.413382 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.413888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:44:49.417514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.498155 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.498738 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.554534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8c0f893-80a0-4860-a507-26b2e9a611c9 req-cdd26a2a-518e-495b-b9e9-5d12999ce5a4 service nova] Releasing lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:49.555313 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:44:49.555467 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:44:49.574329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0db7a185-6cd9-48fe-a188-fdc3ab385578 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "4bf23f6c-34b4-4cec-923b-3cbbc96839fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.815s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:49.583930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.584232 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:44:49.586888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.663791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.664303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.740162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.744093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.824807 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:44:49.825623 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:44:49.825934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:44:49.826126 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:44:49.826521 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:49.828823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.829272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.906001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:49.912461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:49.971858 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:50.008159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.008919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.133897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.138333 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:44:50.142887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.225581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.227357 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.299431 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-44c4539c-6881-4e13-bfcc-86ab46725baa req-b8e586bd-7c10-43b8-939d-e23bf8b1577d service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-deleted-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:50.299597 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-44c4539c-6881-4e13-bfcc-86ab46725baa req-b8e586bd-7c10-43b8-939d-e23bf8b1577d service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Neutron deleted interface ea5ff8aa-c316-4071-9066-3b91d59cb70b; detaching it from the instance and deleting it from the info cache
Jun 26 02:44:50.302220 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-44c4539c-6881-4e13-bfcc-86ab46725baa req-b8e586bd-7c10-43b8-939d-e23bf8b1577d service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Detach interface failed, port_id=ea5ff8aa-c316-4071-9066-3b91d59cb70b, reason: Instance dfe60628-8b47-41d5-967c-678f2402aca5 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:44:50.319984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.320373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:44:50.323314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.373504 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:50.396517 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:50.396950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:50.397116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:50.397227 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:50.397495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] No waiting events found dispatching network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:50.397495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:50.397585 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:50.397704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Acquiring lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:50.397825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:50.397909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] Lock "dfe60628-8b47-41d5-967c-678f2402aca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:50.398001 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] No waiting events found dispatching network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:50.398097 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f8632c5-24dc-4fcc-8eea-88d3ce92b99b req-95186593-b0d2-44d6-ac9f-2cd734112041 service nova] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Received event network-vif-unplugged-ea5ff8aa-c316-4071-9066-3b91d59cb70b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:50.410141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.410592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.496044 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.500594 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'dfe60628-8b47-41d5-967c-678f2402aca5' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dfe60628-8b47-41d5-967c-678f2402aca5' (instance-0000001a)
Jun 26 02:44:50.502297 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:50.503316 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:50.539735 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating instance_info_cache with network_info: [{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:50.548399 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:44:50.548399 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=48983MB free_disk=73.71472549438477GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:44:50.548399 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:50.548696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:50.766399 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:50.905712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:50.905937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:50.906129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:50.906282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:50.906432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:50.908803 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Terminating instance
Jun 26 02:44:51.044494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:44:51.045198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance network_info: |[{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:44:51.270050 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Took 1.44 seconds to deallocate network for instance.
Jun 26 02:44:51.411656 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:44:51.445437 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.450932 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.473082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.481910 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.507943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.508406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.604680 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:51.605257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:51.605257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:51.605257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:51.605509 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] No waiting events found dispatching network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:51.605509 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0091225b-425c-4ba2-ac7f-2156681f97a0 req-93a2789f-2ffb-4aa1-a757-70ee53fcef6f service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:51.614828 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.614953 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ddf5057b-2a8e-4974-934e-1f89155d50f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.616892 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 110dbeda-4ed0-4234-863e-7441034d8449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617238 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617346 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance cb30fcf0-34d3-4008-b128-9bd46080c204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617437 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8c307448-2d6a-4df3-b427-af9db2c9378a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617585 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617684 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617745 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617827 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 716bc480-bbf9-4921-8f5e-d382bf7100ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617900 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance dfe60628-8b47-41d5-967c-678f2402aca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.617983 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 4ee2c5e4-b366-4693-9031-41425bac0cab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:44:51.618162 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:44:51.618284 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:44:50 up 31 min,  2 users,  load average: 7.56, 5.70, 2.90\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_deleting': '2', 'num_os_type_None': '12', 'num_proj_f3004e12281740988b4f5119899f222b': '1', 'io_workload': '1', 'num_task_None': '9', 'num_proj_a94375dca8764ff8b335b461730d4cdb': '2', 'num_proj_0aeb950792b84ac38e258cbabc9785b2': '1', 'num_proj_f149d284f0d24070afe71cccd4c0c744': '1', 'num_proj_5bb8ac3d99734c44bd220c90726dd72d': '4', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_proj_bac7218fd5ea43579f052f1bd83fe39b': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_80653f0bc8cd40e6a86e691a5024e36b': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:44:51.650874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.713623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.719832 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:51.739917 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999736380000058 future=<Future at 0x72e27c2cd6d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:51.740867 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Instance destroyed successfully.
Jun 26 02:44:51.741893 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lazy-loading 'resources' on Instance uuid 5e673f64-351d-4b09-a3be-8316d3a50b5d {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:51.776341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:51.793341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:51.793525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:51.793711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:51.793860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:51.793999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:51.795876 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Terminating instance
Jun 26 02:44:52.143760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:52.143978 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:52.243270 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1919154611',display_name='tempest-ServerActionsTestOtherA-server-1919154611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serveractionstestothera-server-1919154611',id=3,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqt9DnezWDbxvJ/ZxxdY0YB34gHpgoVlH/ILJBkvujlPo4xl5NxhCRn2yfJ0eOPvk47uH37XBLaYdkW40/h0fxl0mUXkcowhvHOopEPRp60cgofnYLnwVwOUk8OjBWmNA==',key_name='tempest-keypair-598742693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:40:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3004e12281740988b4f5119899f222b',ramdisk_id='',reservation_id='r-5ussn8ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1295549616',owner_user_name='tempest-ServerActionsTestOtherA-1295549616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:40:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc748533ff1b49ecbfc2f8e239350cea',uuid=5e673f64-351d-4b09-a3be-8316d3a50b5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:44:52.247175 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converting VIF {"id": "5279d472-fd5f-40b3-9130-196439442d5b", "address": "fa:16:3e:bf:32:cc", "network": {"id": "27091788-94b7-43bc-93be-297a36afa9c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-937200957-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3004e12281740988b4f5119899f222b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5279d472-fd", "ovs_interfaceid": "5279d472-fd5f-40b3-9130-196439442d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:52.247175 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:52.247175 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:44:52.247406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.247570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5279d472-fd, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:52.248584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.249334 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:52.251488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.252504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.252504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12a72208-dbba-4f7e-a67f-fba2e5693007) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:52.254295 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.254932 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:52.256897 np0000003683 nova-compute[98991]: INFO os_vif [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:32:cc,bridge_name='br-int',has_traffic_filtering=True,id=5279d472-fd5f-40b3-9130-196439442d5b,network=Network(27091788-94b7-43bc-93be-297a36afa9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5279d472-fd')
Jun 26 02:44:52.261645 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Deleting instance files /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d_del
Jun 26 02:44:52.261645 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Deletion of /opt/stack/data/nova/instances/5e673f64-351d-4b09-a3be-8316d3a50b5d_del complete
Jun 26 02:44:52.298291 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:44:52.327052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.346386 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.406311 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:52.420265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:44:52.441740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:44:52.478226 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:44:52.479166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fec9:10d3', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe5b:345d', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:feec:5126'] 
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:52.490458 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating existing volume attachment record: d188352c-7074-4f1d-9e17-ab22d7d163a5 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:44:52.499313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.502282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:52.641364 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999596939999947 future=<Future at 0x72e27c180b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:44:52.642714 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Instance destroyed successfully.
Jun 26 02:44:52.643286 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'resources' on Instance uuid 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:52.646834 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:52.767856 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:44:52.768189 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:44:52.768515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:44:52.768670 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:44:52.768967 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:52.861965 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:53.145990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1808343751',display_name='tempest-AttachVolumeNegativeTest-server-1808343751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1808343751',id=22,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO824Ndzq2svfuZhFVCpXk/lE/lW/ykIY4Z5J3eUYFAvZfKj0Rriz27p2Le2sgtu58ONs0QBedvs6lz12bZ+/ey6rnWh0qIxlyvi533avs929W9RXu7J1qosQDz3LaRs4g==',key_name='tempest-keypair-961925864',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:13Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-o30hi8f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:44:53.146246 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "address": "fa:16:3e:a5:10:27", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3439bbb0-32", "ovs_interfaceid": "3439bbb0-3253-40bb-bd4e-e0859ce37da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:53.146888 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:53.147303 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:44:53.148286 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:53.148535 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3439bbb0-32, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:53.151153 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:53.152143 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:53.152889 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:53.153047 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=075bc876-42e9-4672-adab-5f9990e3ea60) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:53.154807 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:53.155463 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:53.156681 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:44:53.156872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.608s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:53.157308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.381s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:53.158100 np0000003683 nova-compute[98991]: INFO os_vif [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:10:27,bridge_name='br-int',has_traffic_filtering=True,id=3439bbb0-3253-40bb-bd4e-e0859ce37da3,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3439bbb0-32')
Jun 26 02:44:53.158791 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:44:53.158936 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Deleting instance files /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107_del
Jun 26 02:44:53.161881 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Deletion of /opt/stack/data/nova/instances/8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107_del complete
Jun 26 02:44:53.167971 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-38f1af97-7d36-4238-ad2f-265b5d4ae7cf req-2a7d3836-639e-45d3-be5e-739eba328af8 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-deleted-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:53.168514 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-38f1af97-7d36-4238-ad2f-265b5d4ae7cf req-2a7d3836-639e-45d3-be5e-739eba328af8 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Neutron deleted interface 5279d472-fd5f-40b3-9130-196439442d5b; detaching it from the instance and deleting it from the info cache
Jun 26 02:44:53.169615 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-38f1af97-7d36-4238-ad2f-265b5d4ae7cf req-2a7d3836-639e-45d3-be5e-739eba328af8 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Detach interface failed, port_id=5279d472-fd5f-40b3-9130-196439442d5b, reason: Instance 5e673f64-351d-4b09-a3be-8316d3a50b5d could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:44:53.618957 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Acquiring lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] No waiting events found dispatching network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Received event network-vif-unplugged-5279d472-fd5f-40b3-9130-196439442d5b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] No waiting events found dispatching network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:53.662857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Acquiring lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:53.663322 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:53.663922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:53.664343 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] No waiting events found dispatching network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:44:53.665585 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0db063a-8e30-4e75-b11a-8f6d0ca32027 req-7dbab8a6-d369-470e-84cc-b095203437d4 service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-unplugged-3439bbb0-3253-40bb-bd4e-e0859ce37da3 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:44:53.667626 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:44:53.668101 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:44:53.668263 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:44:53.668336 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:44:53.668541 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:53.670987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:53.671177 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:53.728137 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:44:54.120653 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Took 1.35 seconds to deallocate network for instance.
Jun 26 02:44:54.128059 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-805abd45-8694-492e-a10e-50ee77175325 req-1fc567fd-a222-4de8-a7c5-a5cec120c28f service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Received event network-vif-deleted-3439bbb0-3253-40bb-bd4e-e0859ce37da3 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:44:54.130390 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-805abd45-8694-492e-a10e-50ee77175325 req-1fc567fd-a222-4de8-a7c5-a5cec120c28f service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Neutron deleted interface 3439bbb0-3253-40bb-bd4e-e0859ce37da3; detaching it from the instance and deleting it from the info cache
Jun 26 02:44:54.131706 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-805abd45-8694-492e-a10e-50ee77175325 req-1fc567fd-a222-4de8-a7c5-a5cec120c28f service nova] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Detach interface failed, port_id=3439bbb0-3253-40bb-bd4e-e0859ce37da3, reason: Instance 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:44:54.158970 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:54.159300 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:54.159536 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:54.159718 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:54.160123 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:44:54.160231 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:44:54.160425 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.18 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:44:54.173772 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:54.329242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:54.329396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:54.577161 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:44:54.608233 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:44:54.609214 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:44:54.609444 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Creating image(s)
Jun 26 02:44:54.609747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:44:54.609866 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Ensure instance console log exists: /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:44:54.610064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:54.610201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:54.610306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:54.610758 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start _get_guest_xml network_info=[{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd188352c-7074-4f1d-9e17-ab22d7d163a5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4ee2c5e4-b366-4693-9031-41425bac0cab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'serial': 'b65cbaba-330c-4119-94ec-e7d911ba72f6'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:44:54.612395 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:44:54.613350 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784', uuid='4ee2c5e4-b366-4693-9031-41425bac0cab'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441894.6130476) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:44:54.614054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:44:54.614380 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:44:54.614976 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:44:54.615118 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:44:54.615969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:44:54.616212 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:44:54.616354 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:44:54.616533 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:44:54.616613 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:44:54.616657 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:44:54.616752 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:44:54.616884 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:44:54.616981 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:44:54.617076 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:44:54.617169 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:44:54.617273 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:44:54.625515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:54.627629 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:44:54.627873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:54.627988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:54.628284 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:54.628485 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:44:54.641318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:54.642245 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:54.642698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:54.642881 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:54.643388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:54.643684 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:54.653630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:54.653630 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:54.658703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:44:54.658703 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6] added
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:54.665642 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:54.665897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:54.665984 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:54.666203 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6] added
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:44:54.672417 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:54.672702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:44:54.672798 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:44:54.672838 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:44:54.683461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.526s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:54.684685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.059s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:54.744835 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Deleted allocations for instance dfe60628-8b47-41d5-967c-678f2402aca5
Jun 26 02:44:54.832191 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Detaching volume 685e3e90-c453-499b-9807-d2eb1d4b3182
Jun 26 02:44:54.877464 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Attempting to driver detach volume 685e3e90-c453-499b-9807-d2eb1d4b3182 from mountpoint /dev/vdb
Jun 26 02:44:54.880841 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdb by alias ua-685e3e90-c453-499b-9807-d2eb1d4b3182 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:44:54.882234 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdb by alias ua-685e3e90-c453-499b-9807-d2eb1d4b3182 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:44:54.882422 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Attempting to detach device vdb from instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <alias name="ua-685e3e90-c453-499b-9807-d2eb1d4b3182"/>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <serial>685e3e90-c453-499b-9807-d2eb1d4b3182</serial>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:44:54.882686 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:44:54.889016 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdb from instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 from the persistent domain config.
Jun 26 02:44:54.889203 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] (1/8): Attempting to detach device vdb with device alias ua-685e3e90-c453-499b-9807-d2eb1d4b3182 from instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <alias name="ua-685e3e90-c453-499b-9807-d2eb1d4b3182"/>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <serial>685e3e90-c453-499b-9807-d2eb1d4b3182</serial>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:44:54.889523 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:44:55.079713 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Took 1.41 seconds to deallocate network for instance.
Jun 26 02:44:55.243609 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:55.244043 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:55.393194 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441895.392769, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => ua-685e3e90-c453-499b-9807-d2eb1d4b3182> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:44:55.394160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-685e3e90-c453-499b-9807-d2eb1d4b3182 for instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:44:55.396009 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdb from instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 from the live domain config.
Jun 26 02:44:55.396826 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:44:55.397068 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:44:55.397185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:44:55.585261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:55.666747 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:44:55.673350 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:55.679397 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:44:55.685850 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.691721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.698501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.707612 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.707844 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.714410 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.714649 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:55.746190 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:55.754636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-27a85b22-8c5f-4b39-94f3-ac3d7d7bdb96 tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Lock "dfe60628-8b47-41d5-967c-678f2402aca5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.791s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:55.761648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.40.100,3260]
Jun 26 02:44:55.761648 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:55.761648 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.767004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.50.100,3260]
Jun 26 02:44:55.767004 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:55.767004 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.777432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.778239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.797119 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.797548 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:55.797901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:55.797901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:55.799267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('7', '-', '-', 0) found on session 52 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:55.799425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.802503 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:55.802774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:55.802938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:55.803027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:44:55.803887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('16', '-', '-', 0) found on session 53 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:44:55.803979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:44:55.816549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 52 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:55.816812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:55.822584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 53 and hctl ['16', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:56.256819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.572s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:56.258190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.672s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:56.345527 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Deleted allocations for instance 5e673f64-351d-4b09-a3be-8316d3a50b5d
Jun 26 02:44:56.652727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:56.820786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 53 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:44:56.821015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:44:56.821775 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:44:56.821992 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:44:57.261836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:57.324449 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:44:57.356678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-12a8e08f-c019-491a-a152-86c34550dbb2 tempest-ServerActionsTestOtherA-1295549616 tempest-ServerActionsTestOtherA-1295549616-project-member] Lock "5e673f64-351d-4b09-a3be-8316d3a50b5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.451s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:57.661270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Found WWN 3300000005c7a197b for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:44:57.661623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:57.661885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000005c7a197b', 'path': '/dev/dm-2', 'multipath_id': '3300000005c7a197b'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:57.662016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c7a197b', 'path': '/dev/dm-2', 'multipath_id': '3300000005c7a197b'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:44:57.662534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.265s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:44:57.662963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '685e3e90-c453-499b-9807-d2eb1d4b3182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:44:57.663143 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:57.689115 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:44:57.689451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '50')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:57.690424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '51')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:44:57.691260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4edd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:44:57.691465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Removing multipathed devices sdj, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:44:57.691718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flush multipath device 33000000071d62c9d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:44:57.726666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:57.793121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:44:57.830745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.574s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:57.841042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:44:57.841268 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:44:57.842642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if device paths {'sdj', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:44:57.856307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Device paths {'sdj', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:44:57.856517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:44:57.868688 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.897869 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Deleted allocations for instance 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107
Jun 26 02:44:57.902141 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260]
Jun 26 02:44:57.902141 np0000003683 nova-compute[98991]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.40.100,3260] successful.
Jun 26 02:44:57.902141 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.920082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.930972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.973665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260]
Jun 26 02:44:57.973665 np0000003683 nova-compute[98991]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182, portal: 192.168.50.100,3260] successful.
Jun 26 02:44:57.973665 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.993029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:44:57.993199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:44:57.993304 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== disconnect_volume: return (2595ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:44:57.993417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:44:58.153800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.167696 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1022542784',id=27,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-wi38uuy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:48Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=4ee2c5e4-b366-4693-9031-41425bac0cab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:44:58.167901 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:58.168330 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:58.169137 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:58.543617 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <uuid>4ee2c5e4-b366-4693-9031-41425bac0cab</uuid>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <name>instance-0000001b</name>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1022542784</nova:name>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:44:54</nova:creationTime>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         <nova:port uuid="0582cc95-95b0-43fe-b8a4-737e34bdb240">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="serial">4ee2c5e4-b366-4693-9031-41425bac0cab</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="uuid">4ee2c5e4-b366-4693-9031-41425bac0cab</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <alias name="ua-b65cbaba-330c-4119-94ec-e7d911ba72f6"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-2"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <serial>b65cbaba-330c-4119-94ec-e7d911ba72f6</serial>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:27:8f:65"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <target dev="tap0582cc95-95"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/console.log" append="off"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:44:58.671867 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Preparing to wait for external event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1022542784',id=27,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-wi38uuy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:44:48Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=4ee2c5e4-b366-4693-9031-41425bac0cab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:44:58.674674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.675200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:58.675200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:44:58.675965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.676118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b9ce262-c8f3-577c-b4e9-c04b06b2f715', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:58.680806 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.681401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:58.683402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.687120 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.687349 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0582cc95-95, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:58.687814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0582cc95-95, col_values=(('qos', UUID('b2f20cb6-09a9-4306-8aba-7998d13fb48d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:58.688029 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0582cc95-95, col_values=(('external_ids', {'iface-id': '0582cc95-95b0-43fe-b8a4-737e34bdb240', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:8f:65', 'vm-uuid': '4ee2c5e4-b366-4693-9031-41425bac0cab'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:44:58.688946 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.690217 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:44:58.695741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:58.697235 np0000003683 nova-compute[98991]: INFO os_vif [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95')
Jun 26 02:44:58.905386 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7ec73490-d658-43b1-80c3-c93c7809ea39 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.112s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:59.006738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:59.425353 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:44:59.553821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-698144cd-74d1-4caa-81b7-30bed00ebe26 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.224s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:44:59.614691 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:59.614862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:59.645731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:44:59.645885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:44:59.646009 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:44:59.647934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98991) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 26 02:44:59.648377 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:00.117953 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Detaching volume 3503bbb3-d5d3-4d48-8244-7830266b9ad4
Jun 26 02:45:00.165492 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Attempting to driver detach volume 3503bbb3-d5d3-4d48-8244-7830266b9ad4 from mountpoint /dev/vdb
Jun 26 02:45:00.169060 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:00.170800 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:00.170879 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Attempting to detach device vdb from instance ddf5057b-2a8e-4974-934e-1f89155d50f5 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <alias name="ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4"/>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <serial>3503bbb3-d5d3-4d48-8244-7830266b9ad4</serial>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:00.171340 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:00.179066 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance ddf5057b-2a8e-4974-934e-1f89155d50f5 from the persistent domain config.
Jun 26 02:45:00.179197 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] (1/8): Attempting to detach device vdb with device alias ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4 from instance ddf5057b-2a8e-4974-934e-1f89155d50f5 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <alias name="ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4"/>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <serial>3503bbb3-d5d3-4d48-8244-7830266b9ad4</serial>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:00.179410 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:00.211954 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:00.212086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:00.212180 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:27:8f:65, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:00.212684 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Using config drive
Jun 26 02:45:00.346381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:00.346381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:00.547153 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003227019999485492 future=<Future at 0x72e27c33f710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:00.547153 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441885.54584, 4bf23f6c-34b4-4cec-923b-3cbbc96839fa => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:00.547153 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:00.547758 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] VM Stopped (Lifecycle Event)
Jun 26 02:45:00.548651 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.2515683480000916 future=<Future at 0x72e27c2b32f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:00.548651 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.2514451389999977 future=<Future at 0x72e27c2b32f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:00.675904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441900.675592, ddf5057b-2a8e-4974-934e-1f89155d50f5 => ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:45:00.677213 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3503bbb3-d5d3-4d48-8244-7830266b9ad4 for instance ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:45:00.679235 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance ddf5057b-2a8e-4974-934e-1f89155d50f5 from the live domain config.
Jun 26 02:45:00.688899 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.693382 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:00.693382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:00.693382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:00.694022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:00.694022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3503bbb3-d5d3-4d48-8244-7830266b9ad4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:00.694022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:00.709968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.720784 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:00.726785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:00.726994 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:00.727149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:00.727291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:00.727838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.729583 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:00.731103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c31bce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:00.731325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:00.731648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flush multipath device 330000000d83a0e9a {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:00.741375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.756632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.771824 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:00.835115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:00.849817 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Detaching volume 0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6
Jun 26 02:45:00.877913 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Creating config drive at /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config
Jun 26 02:45:00.881788 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfxe6mqq3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:00.896137 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:00.907024 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Attempting to driver detach volume 0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 from mountpoint /dev/vdb
Jun 26 02:45:00.921701 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:00.921701 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:00.922242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:00.922304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:00.922432 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:00.922577 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e2df0f2d-19b1-4ab2-92ae-cdc2773026c5 req-d5cd36bb-fc27-4b55-8819-c0da2cd88fb3 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state active and task_state powering-off.
Jun 26 02:45:00.924733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:00.924733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Found disk vdb by alias ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Found disk vdb by alias ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Attempting to detach device vdb from instance 110dbeda-4ed0-4234-863e-7441034d8449 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <alias name="ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6"/>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <serial>0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6</serial>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:00.928527 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:00.928978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:00.938859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfxe6mqq3" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:00.946203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:00.946544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:00.947831 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Successfully detached device vdb from instance 110dbeda-4ed0-4234-863e-7441034d8449 from the persistent domain config.
Jun 26 02:45:00.948000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] (1/8): Attempting to detach device vdb with device alias ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 from instance 110dbeda-4ed0-4234-863e-7441034d8449 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <alias name="ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6"/>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <serial>0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6</serial>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:00.948268 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:00.958991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.008111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.40.100,3260]
Jun 26 02:45:01.008111 np0000003683 nova-compute[98991]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:01.008111 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.027129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.040203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.050039 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4bf23f6c-34b4-4cec-923b-3cbbc96839fa] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:01.075114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.50.100,3260]
Jun 26 02:45:01.075114 np0000003683 nova-compute[98991]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:01.075114 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.091656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.092044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:01.092232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== disconnect_volume: return (399ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:01.092633 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:01.239285 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999614742999938 future=<Future at 0x72e27c1f3da0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:01.245322 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance destroyed successfully.
Jun 26 02:45:01.246667 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'numa_topology' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:01.498332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.533605 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.538619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.588339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441901.5880146, 110dbeda-4ed0-4234-863e-7441034d8449 => ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:45:01.591700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 for instance 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:45:01.594346 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Successfully detached device vdb from instance 110dbeda-4ed0-4234-863e-7441034d8449 from the live domain config.
Jun 26 02:45:01.595460 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:01.596093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:01.596093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:01.596460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:01.596896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:01.597085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:01.624594 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:01.624851 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:01.624991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:01.625098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:01.626501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:01.627855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c578ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:01.628033 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:01.628349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Flush multipath device 330000000329ddc43 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:01.654601 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:01.655661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.662453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.670042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:01.700302 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9764ab40-d8f0-492e-8ad1-30a18d0ea82a req-950f9054-9ff2-48cb-a286-7b4697e7e346 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:01.700778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9764ab40-d8f0-492e-8ad1-30a18d0ea82a req-950f9054-9ff2-48cb-a286-7b4697e7e346 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:01.700778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9764ab40-d8f0-492e-8ad1-30a18d0ea82a req-950f9054-9ff2-48cb-a286-7b4697e7e346 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:01.700778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9764ab40-d8f0-492e-8ad1-30a18d0ea82a req-950f9054-9ff2-48cb-a286-7b4697e7e346 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:01.700910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9764ab40-d8f0-492e-8ad1-30a18d0ea82a req-950f9054-9ff2-48cb-a286-7b4697e7e346 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Processing event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:01.719232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:01.721769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:01.751181 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:01.751463 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:01.764903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:01.765036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:01.766420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:01.778147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:01.778360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:01.791967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.825279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.40.100,3260]
Jun 26 02:45:01.825279 np0000003683 nova-compute[98991]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:01.825279 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.841885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.858125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.895166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.50.100,3260]
Jun 26 02:45:01.895166 np0000003683 nova-compute[98991]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:01.895166 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.909377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:01.909772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:01.909940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] <== disconnect_volume: return (314ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:01.910086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:02.261139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a8b6e4fc-02d0-43f9-b4ef-6555e8ab5294 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.615s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:02.387653 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:02.388395 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441902.3881419, 4ee2c5e4-b366-4693-9031-41425bac0cab => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:02.388631 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Started (Lifecycle Event)
Jun 26 02:45:02.390211 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:02.392089 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance spawned successfully.
Jun 26 02:45:02.393119 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:02.464767 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'flavor' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:02.662994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a489fa06-1595-4ef6-987e-70bc74278e5d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.048s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:02.892277 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:02.893330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:02.897851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.898092 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.898426 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.898815 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.899233 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.900501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:02.902989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:02.903146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:02.903304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:02.903426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:02.903558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:02.907957 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Terminating instance
Jun 26 02:45:02.973518 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:02.973836 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:02.974009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:02.974393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:02.974533 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:02.974701 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-5cac1b47-f504-4ea5-8507-08db22dfdf2a req-19a4ac48-2da1-4e6d-8ed4-9b776f83cce0 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state stopped and task_state None.
Jun 26 02:45:03.397794 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:03.397984 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441903.3978186, 4ee2c5e4-b366-4693-9031-41425bac0cab => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:03.398089 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Paused (Lifecycle Event)
Jun 26 02:45:03.400229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.404339 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Took 8.80 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:03.404719 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:03.412057 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:03.444177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.470313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.472074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0e75ca1e-76eb-4ad8-8960-107770617d43 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.126s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:03.474350 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.507365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.508281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.651016 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:03.651178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:03.651326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:03.651439 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:03.651571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] No waiting events found dispatching network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:03.651701 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cf01f613-6b06-4a09-a282-09d75cf794cc req-85c0cc31-ff01-41ef-acc5-f4c236a53048 service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:03.675226 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:03.690437 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.733144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.751730 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:03.768784 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Instance destroyed successfully.
Jun 26 02:45:03.769501 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'resources' on Instance uuid ddf5057b-2a8e-4974-934e-1f89155d50f5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:03.800601 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004773860000568675 future=<Future at 0x72e27c2b32f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:03.800791 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:03.801006 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.938694152000153 future=<Future at 0x72e27c2cd6d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:03.801108 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.9385385220000444 future=<Future at 0x72e27c2cd6d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:03.801676 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] Emitting event <LifecycleEvent: 1782441888.7999763, dfe60628-8b47-41d5-967c-678f2402aca5 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:03.801843 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] VM Stopped (Lifecycle Event)
Jun 26 02:45:03.877465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:03.878029 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:03.903902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:03.905002 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441903.904706, 4ee2c5e4-b366-4693-9031-41425bac0cab => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:03.905191 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Resumed (Lifecycle Event)
Jun 26 02:45:03.918978 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Took 19.74 seconds to build instance.
Jun 26 02:45:03.965131 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:03.965618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:03.965993 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:03.966122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:03.966267 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:03.966381 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4189d872-d074-4541-a07e-cfbe3e376ea1 req-20c01281-aca6-4ceb-b6e7-f5bf73759ce8 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state active and task_state None.
Jun 26 02:45:04.182340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:04.182468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquired lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:04.182658 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:04.182723 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'info_cache' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:04.199951 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:04.200163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:04.200405 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:04.200653 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:04.200825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:04.203684 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Terminating instance
Jun 26 02:45:04.272857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981603150',display_name='tempest-AttachVolumeNegativeTest-server-1981603150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1981603150',id=15,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvWRXS6eTvR+tRz06ncV/wUjaTDuBCmsLQmirBPs7vyrzFiQt65GFEskzftqv5o9ZT94lHre8FVSGxsfFwqWX4kZYxxcQ6+JLHfJUf0B4V/lc1q+EuWa+wXFDkW406z1A==',key_name='tempest-keypair-2044668074',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:42:55Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0u0zn63e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=ddf5057b-2a8e-4974-934e-1f89155d50f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:04.273129 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "address": "fa:16:3e:c6:5c:b4", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fb86c6-1e", "ovs_interfaceid": "30fb86c6-1ea8-4dc9-9b71-4422105a3c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:04.273888 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:04.274183 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:04.276785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.277064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fb86c6-1e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:04.280319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:04.285788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.287003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.287196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e29c905a-7ce3-4c4c-b73e-88cd68c693de) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:04.290202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.290758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:04.297190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.299327 np0000003683 nova-compute[98991]: INFO os_vif [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5c:b4,bridge_name='br-int',has_traffic_filtering=True,id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fb86c6-1e')
Jun 26 02:45:04.299681 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Deleting instance files /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5_del
Jun 26 02:45:04.300631 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Deletion of /opt/stack/data/nova/instances/ddf5057b-2a8e-4974-934e-1f89155d50f5_del complete
Jun 26 02:45:04.307263 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c7a6c91e-8e8d-47a4-802c-9e4ceb0311ee tempest-VolumesAdminNegativeTest-405224716 tempest-VolumesAdminNegativeTest-405224716-project-member] [instance: dfe60628-8b47-41d5-967c-678f2402aca5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:04.382501 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:04.407732 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:04.410315 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:04.422593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.251s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:04.685903 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:04.706804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:04.743125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.748258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.775758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.785604 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.810944 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Took 1.40 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:04.812189 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:04.812189 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:04.812189 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:04.812371 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:04.823848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:04.894501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:04.913259 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999735898000154 future=<Future at 0x72e27c28f500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:05.050068 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999664715000108 future=<Future at 0x72e27c2f1a60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:05.051692 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Instance destroyed successfully.
Jun 26 02:45:05.052122 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lazy-loading 'resources' on Instance uuid 110dbeda-4ed0-4234-863e-7441034d8449 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:05.187625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a79cd8e8-08ab-47fe-a2cf-1d769d183352 req-13ca433d-0ed4-4be7-bb14-21abc3c3242e service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:05.188126 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:05.238345 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Rescuing
Jun 26 02:45:05.238598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:05.238719 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:05.238853 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:05.390149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:05.555690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987187591',display_name='tempest-ServerStableDeviceRescueTest-server-1987187591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverstabledevicerescuetest-server-1987187591',id=16,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBMJg8UMI308yfJ7kxj58PBigfJuGmKE/LcCk0a0HVYoeNNxvQ4y2i2EGyXOLTXdpZWFnK2zxrlWkc5M6vsfhYXZfZC8hz+K4lTbmmyph4/VA0TVytbXE61gUItwip0Q==',key_name='tempest-keypair-1504413044',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:20Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aeb950792b84ac38e258cbabc9785b2',ramdisk_id='',reservation_id='r-mkw01xlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-502021662',owner_user_name='tempest-ServerStableDeviceRescueTest-502021662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c50f6bfbb4d348c72bbd8356447a9',uuid=110dbeda-4ed0-4234-863e-7441034d8449,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:05.556488 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converting VIF {"id": "fbe3af3d-b581-4979-9370-666943905e41", "address": "fa:16:3e:3c:62:40", "network": {"id": "c537b81f-3d07-4367-8960-a1d8637a134a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1512776699-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0aeb950792b84ac38e258cbabc9785b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe3af3d-b5", "ovs_interfaceid": "fbe3af3d-b581-4979-9370-666943905e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:05.557044 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:05.557308 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:05.560113 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:05.562175 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.562370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbe3af3d-b5, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:05.563309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.564044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:05.569874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.570302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.570429 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a42ba1c2-17c9-48b7-a5a9-d3c786acae79) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:05.570996 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.571430 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:05.576752 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:05.578375 np0000003683 nova-compute[98991]: INFO os_vif [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:62:40,bridge_name='br-int',has_traffic_filtering=True,id=fbe3af3d-b581-4979-9370-666943905e41,network=Network(c537b81f-3d07-4367-8960-a1d8637a134a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe3af3d-b5')
Jun 26 02:45:05.578644 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Deleting instance files /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449_del
Jun 26 02:45:05.579310 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Deletion of /opt/stack/data/nova/instances/110dbeda-4ed0-4234-863e-7441034d8449_del complete
Jun 26 02:45:05.730309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:05.731166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] Acquiring lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:05.731697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:05.731697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:05.731697 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] No waiting events found dispatching network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:05.731946 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-unplugged-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:05.731946 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Received event network-vif-deleted-30fb86c6-1ea8-4dc9-9b71-4422105a3c2b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:05.732172 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Neutron deleted interface 30fb86c6-1ea8-4dc9-9b71-4422105a3c2b; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:05.734651 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f3668de-599f-442c-9fb4-30f370ac20fd req-0b297aa8-1a46-49de-b5af-1d025bc3286a service nova] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Detach interface failed, port_id=30fb86c6-1ea8-4dc9-9b71-4422105a3c2b, reason: Instance ddf5057b-2a8e-4974-934e-1f89155d50f5 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:05.738433 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:05.741469 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:05.864580 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:06.036214 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:06.036683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:06.087579 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:06.090734 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:06.090734 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:06.090734 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:06.090734 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:06.103456 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:06.111855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:06.226810 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:06.242908 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Releasing lock "refresh_cache-ed3b38c4-c012-4f44-8801-8bc21e30c0c5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:06.271597 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating instance_info_cache with network_info: [{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:06.366853 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Took 1.55 seconds to deallocate network for instance.
Jun 26 02:45:06.443312 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:06.471656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:06.471828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:06.472406 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Attaching volume 7cacc37a-9715-4bfb-9636-ac3b6f539b4d to /dev/vdb
Jun 26 02:45:06.524391 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:06.543213 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:06.552037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:45:06.586899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:06.631223 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:45:06.631639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:45:06.651061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:45:06.651061 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:fec9:10d3', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe5b:345d', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:feec:5126', 'fe80::fc16:3eff:fe27:8f65'] 
Jun 26 02:45:06.651061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:45:06.651502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:45:06.651502 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:06.652543 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updating existing volume attachment record: ded77151-a762-43b1-9c89-fb03c0b915d2 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:45:06.657850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:06.740145 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00048189899985118245 future=<Future at 0x72e27c2cd6d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:06.740774 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441891.7395709, 5e673f64-351d-4b09-a3be-8316d3a50b5d => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:06.740957 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:06.741098 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] VM Stopped (Lifecycle Event)
Jun 26 02:45:06.742771 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.8986713379999856 future=<Future at 0x72e27c180b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:06.742771 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.8985085550000349 future=<Future at 0x72e27c180b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:06.773990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:06.876440 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:06.876628 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:07.052708 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Ignoring supplied device name: /dev/vdb
Jun 26 02:45:07.170369 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:07.244073 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba287ae6-fbe2-4f18-9501-3c2791d30f7f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 5e673f64-351d-4b09-a3be-8316d3a50b5d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:07.255988 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '159e9cea-d640-42ca-b93d-9f5b3cfc4ff3', 'attached_at': '', 'detached_at': '', 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'serial': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:45:07.259830 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:07.260570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:07.260792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:07.261579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:07.262100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:07.272717 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance destroyed successfully.
Jun 26 02:45:07.273292 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'numa_topology' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:07.277464 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:07.278365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:07.279461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:07.279720 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:07.280127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:07.280393 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:07.295504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:07.295504 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:07.303208 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:07.307119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] Acquiring lock "110dbeda-4ed0-4234-863e-7441034d8449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:07.307119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:07.307119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] Lock "110dbeda-4ed0-4234-863e-7441034d8449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:07.307119 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] No waiting events found dispatching network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:07.307119 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f8ebea2b-659e-447d-83d3-599c55cab122 req-41216874-c718-4de5-b8dd-e1491710f51d service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-unplugged-fbe3af3d-b581-4979-9370-666943905e41 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:07.311451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:07.311451 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d] added
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:07.319294 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:07.319779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:07.319779 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0399(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:07.319970 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d] added
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:07.325782 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:07.325964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:07.326111 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:07.326284 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:07.469355 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:07.470032 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:07.559905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:07.641335 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003010299999459676 future=<Future at 0x72e27c180b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:07.641678 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441892.6408257, 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:07.641805 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:07.641990 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] VM Stopped (Lifecycle Event)
Jun 26 02:45:07.642576 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.596425530000033 future=<Future at 0x72e27c1f3da0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:07.642576 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.596319512000036 future=<Future at 0x72e27c1f3da0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:07.672520 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Took 1.58 seconds to deallocate network for instance.
Jun 26 02:45:07.775576 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:07.775853 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'resources' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:07.806208 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-82902921-eadc-4499-adcb-69212eb6a92e req-638e4317-0b42-4623-9a0a-d6a4b7177fe1 service nova] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Received event network-vif-deleted-fbe3af3d-b581-4979-9370-666943905e41 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:07.972718 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:08.144435 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8d7d1223-4b53-4cb6-a2d6-e0dcc94d8107] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:08.178672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:08.277525 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:08.278136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:08.278275 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:08.278882 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:08.279091 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:08.280218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.280502 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a37bc6-1d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:08.281593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.282333 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:08.283443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.284321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.284445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b6c2f29-3880-489c-aa2d-33f3de975e07) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:08.285384 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.285677 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:08.286757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.288435 np0000003683 nova-compute[98991]: INFO os_vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:45:08.293990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start _get_guest_xml network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:08.295609 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:08.296588 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-54203554', uuid='ed3b38c4-c012-4f44-8801-8bc21e30c0c5'), owner=OwnerMeta(userid='b19b282009bd41bd924982574984e524', username='tempest-AttachVolumeTestJSON-391502958-project-member', projectid='f149d284f0d24070afe71cccd4c0c744', projectname='tempest-AttachVolumeTestJSON-391502958'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441908.296282) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:08.298639 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:08.299105 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:08.300239 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:08.300406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:08.301190 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:08.301457 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:08.301642 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:08.301762 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:08.301906 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:08.302021 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:08.302144 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:08.302323 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:08.302452 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:08.302611 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:08.302746 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:08.302887 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:08.303041 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:08.320360 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:08.326731 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:08.341959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:08.347615 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.353804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.362434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.369149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.369149 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.369149 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.369149 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.369149 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:08.369367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.369367 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.369367 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.369367 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.369367 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:08.376677 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.376677 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.376677 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.376677 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.376677 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:08.376876 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.376876 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.376876 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.376876 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.376876 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:08.399574 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.402874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.407638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.50.100,3260]
Jun 26 02:45:08.407638 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:08.407638 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.419272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.426058 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.428553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.40.100,3260]
Jun 26 02:45:08.428553 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:08.428553 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.434703 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.434932 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:08.435272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:08.435382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:08.436207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('8', '-', '-', 0) found on session 54 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:08.436312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:08.442362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:08.450334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 54 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:08.450455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:08.460180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:08.460640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:08.460996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('9', '-', '-', 0) found on session 55 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:08.461591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:08.475305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 55 and hctl ['9', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:08.480751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.603s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:08.482247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.304s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:08.557925 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Deleted allocations for instance ddf5057b-2a8e-4974-934e-1f89155d50f5
Jun 26 02:45:08.560722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.563748 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:08.591995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:08.592205 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:08.592389 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Attaching volume 65e6c2a2-e8cd-463e-81e0-ea24735a79d4 to /dev/vdb
Jun 26 02:45:08.644533 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:08.658648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:45:08.683896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:08.720503 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99878020899996 future=<Future at 0x72e27c2cf950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:08.721991 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance destroyed successfully.
Jun 26 02:45:08.722778 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:08.725403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:45:08.727026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:45:08.738672 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:45:08.740052 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:fec9:10d3', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe5b:345d', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:feec:5126'] 
Jun 26 02:45:08.740203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:45:08.740316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:45:08.740539 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:08.740760 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updating existing volume attachment record: b8e7ae75-b6b8-46b8-896a-fc0297ceb179 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:45:08.808661 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:08.823686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:08.823919 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:08.825512 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:08.825512 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'pci_devices' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:08.992338 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:08.992639 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:09.227146 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Attempting a stable device rescue
Jun 26 02:45:09.293930 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:09.293930 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:09.294201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:09.314016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:45:09.317746 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:45:09.317915 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Creating image(s)
Jun 26 02:45:09.318364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:09.318522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:09.319043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:09.319259 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:09.327273 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <uuid>ed3b38c4-c012-4f44-8801-8bc21e30c0c5</uuid>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <name>instance-00000011</name>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeTestJSON-server-54203554</nova:name>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:08</nova:creationTime>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:user uuid="b19b282009bd41bd924982574984e524">tempest-AttachVolumeTestJSON-391502958-project-member</nova:user>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:project uuid="f149d284f0d24070afe71cccd4c0c744">tempest-AttachVolumeTestJSON-391502958</nova:project>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         <nova:port uuid="a0a37bc6-1dae-4326-bcc9-fae26e81828a">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="serial">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="uuid">ed3b38c4-c012-4f44-8801-8bc21e30c0c5</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk.config"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:39:e3:37"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <target dev="tapa0a37bc6-1d"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/console.log" append="off"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:09.328936 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:09.330877 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:09.431838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:09.432324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:09.474689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 55 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:09.474938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:09.496545 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:09.515962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:09.516807 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:09.568773 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4270fb6d-bd41-4810-9696-249529a34b6f tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "ddf5057b-2a8e-4974-934e-1f89155d50f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.665s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:09.719908 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:09.720112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:09.822785 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:09.823147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "371c9edb534d2da52280ed592e97a2872cba237e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:09.823665 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "371c9edb534d2da52280ed592e97a2872cba237e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:10.005981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.524s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:10.018553 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:10.019250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.066918 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Deleted allocations for instance 110dbeda-4ed0-4234-863e-7441034d8449
Jun 26 02:45:10.109076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.109617 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:10.109905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.197685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.198119 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Cannot resize image /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:10.198342 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'migration_context' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:10.222787 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:10.303904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 330000000cd8782d1 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:45:10.306247 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:10.307695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.013s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:10.307695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:10.311467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000cd8782d1', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cd8782d1'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:10.311700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd8782d1', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cd8782d1'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:45:10.314560 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:45:10.314796 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:45:10.317908 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:45:10.318896 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x72e27c4a98e0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '159e9cea-d640-42ca-b93d-9f5b3cfc4ff3', 'attached_at': '', 'detached_at': '', 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'serial': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:45:10.319232 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.cryptsetup [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
Jun 26 02:45:10.319535 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98991) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 26 02:45:10.319719 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.cryptsetup [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] opening encrypted volume /dev/dm-0 {{(pid=98991) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
Jun 26 02:45:10.321060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:10.321976 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:10.322617 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:10.322617 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:10.323030 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:10.323225 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:10.338370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:10.338370 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:10.344932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:10.344932 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4] added
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:10.352588 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4] added
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:10.356367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:10.356586 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:10.356793 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:10.409176 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:10.433285 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.436236 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.436583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.519489 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.part --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.519489 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] 3af72478-2237-45c2-b51b-adeb93bbf547 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:45:10.520865 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:45:10.520865 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.part /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.616275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.part /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.converted" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.621468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.700312 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e.converted --force-share --output=json" returned: 0 in 0.078s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.700942 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "371c9edb534d2da52280ed592e97a2872cba237e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.877s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:10.701738 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Object Instance<ed3b38c4-c012-4f44-8801-8bc21e30c0c5> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:10.702240 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.703856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:10.704736 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:10.705461 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:10.705931 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:10.708624 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.709085 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.709673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:10.709999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:10.711136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "371c9edb534d2da52280ed592e97a2872cba237e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:10.711488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "371c9edb534d2da52280ed592e97a2872cba237e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:10.711862 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.714200 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:10.714493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.714658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.714823 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e570000e-ebe4-53e7-a767-d8252633b11d', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:10.727059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.728852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:10.737281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.743508 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.744403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a37bc6-1d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:10.745109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0a37bc6-1d, col_values=(('qos', UUID('40f8d581-673e-45b0-a861-2b039e3ece6c')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:10.745345 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0a37bc6-1d, col_values=(('external_ids', {'iface-id': 'a0a37bc6-1dae-4326-bcc9-fae26e81828a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:e3:37', 'vm-uuid': 'ed3b38c4-c012-4f44-8801-8bc21e30c0c5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:10.749681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:10.758221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:10.758987 np0000003683 nova-compute[98991]: INFO os_vif [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:45:10.796435 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:10.796778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:10.801213 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:10.801489 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Claim successful on node np0000003683
Jun 26 02:45:10.805384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.805797 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e,backing_fmt=raw /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:10.869801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/371c9edb534d2da52280ed592e97a2872cba237e,backing_fmt=raw /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.rescue" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:10.870306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "371c9edb534d2da52280ed592e97a2872cba237e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:10.870718 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'migration_context' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:10.915511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Attempting to attach volume 7cacc37a-9715-4bfb-9636-ac3b6f539b4d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:   <alias name="ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d"/>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:   <serial>7cacc37a-9715-4bfb-9636-ac3b6f539b4d</serial>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:10.917127 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:45:11.081685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9f9a22fa-2259-4368-a120-5603660bf46a tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Lock "110dbeda-4ed0-4234-863e-7441034d8449" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.881s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:11.126573 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.354796 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:11.357206 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:11.368420 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.370872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.375807 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:11.375807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:11.375807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start _get_guest_xml network_info=[{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:27:8f:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3af72478-2237-45c2-b51b-adeb93bbf547', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd188352c-7074-4f1d-9e17-ab22d7d163a5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '4ee2c5e4-b366-4693-9031-41425bac0cab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'serial': 'b65cbaba-330c-4119-94ec-e7d911ba72f6'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:11.375807 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:11.381109 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.385001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.400184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.407106 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.407309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:11.412690 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.417610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.423265 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:11.458629 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.40.100,3260]
Jun 26 02:45:11.458629 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:11.458629 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.468121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.50.100,3260]
Jun 26 02:45:11.468121 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:11.468121 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.478131 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.483706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:11.499042 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.502770 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.503595 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:11.505689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:11.505689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:11.505689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] HCTL ('10', '-', '-', 0) found on session 56 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:11.505689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.514537 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:11.515100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:11.516008 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] HCTL ('13', '-', '-', 0) found on session 57 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:11.516110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:11.530174 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching for a device in session 56 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:11.530445 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:11.548246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching for a device in session 57 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:11.548246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:11.662847 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.777193 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.785678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.787300 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.817261 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.822500 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:11.882225 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:11.886937 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:11.888382 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784', uuid='4ee2c5e4-b366-4693-9031-41425bac0cab'), owner=OwnerMeta(userid='549e56d3a63947e894b5d6d92dd4eafa', username='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member', projectid='5bb8ac3d99734c44bd220c90726dd72d', projectname='tempest-ServerBootFromVolumeStableRescueTest-1363934813'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:27:8f:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441911.887941) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:11.897830 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:11.898267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:11.903277 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:11.903602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:11.904978 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:11.905326 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:11.905490 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:11.905621 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:11.905752 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:11.905885 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:11.905955 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:11.906198 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:11.906248 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:11.906345 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:11.906457 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:11.908673 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:11.908852 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:12.264833 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for ed3b38c4-c012-4f44-8801-8bc21e30c0c5 due to new event <LifecycleEvent: 1782441912.2644117, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:45:12.264993 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441912.2644117, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:12.265194 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Resumed (Lifecycle Event)
Jun 26 02:45:12.266418 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:12.273459 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance rebooted successfully.
Jun 26 02:45:12.277076 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:12.277343 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:12.324862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:45:12.415011 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:12.430131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:12.518624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:12.519717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:12.519950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:12.520506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:12.520991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:12.521398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:12.521613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:12.595166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:12.595326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:12.768331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:12.771186 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:12.776339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:12.776469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:12.776630 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:12.776741 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:c9:10:d3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:12.781253 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:13.099502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:13.276038 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 26 02:45:13.276455 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441913.2762246, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:13.276670 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Started (Lifecycle Event)
Jun 26 02:45:13.300229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.503s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:13.301581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:13.343212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found WWN 33000000058e30668 for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:45:13.343630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:13.343830 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== connect_volume: return (4050ms) {'type': 'block', 'scsi_wwn': '33000000058e30668', 'path': '/dev/dm-5', 'multipath_id': '33000000058e30668'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:13.343993 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058e30668', 'path': '/dev/dm-5', 'multipath_id': '33000000058e30668'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:45:13.344812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.823s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:13.345257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:13.346543 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:13.360677 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:13.362174 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:13.363006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:13.363206 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:13.363460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:13.363776 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:13.375237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:13.378733 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:13.388454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:13.394145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.405686 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.043s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:13.406056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:13.406711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('7', '0', '0', 0) found on session 52 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:13.406808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.413584 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:13.413808 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:13.413971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:13.414024 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:13.414464 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] HCTL ('16', '0', '0', 0) found on session 53 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:13.414588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:13.415487 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 52 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:13.415847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:13.422967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Searching for a device in session 53 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:13.423081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:13.587944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:13.672577 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:13.672769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:13.678499 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:13.678499 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Claim successful on node np0000003683
Jun 26 02:45:13.780256 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:13.782897 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:13.810472 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:13.810761 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:13.811346 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:13.811652 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:13.816855 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:13.816977 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:13.817118 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:39:e3:37, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:13.817584 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dd413cd4-0c83-407c-82cd-09f3b0d0db3f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:13.850996 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Attempting to attach volume 65e6c2a2-e8cd-463e-81e0-ea24735a79d4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:   <alias name="ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4"/>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:   <serial>65e6c2a2-e8cd-463e-81e0-ea24735a79d4</serial>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:13.852400 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:45:13.939257 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7340727e31547a4b39299401535770d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7eadbb081143fb8f96d0187a0f7c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:14.286052 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 26 02:45:14.317245 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:14.366978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:45:14.431779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-15b27fdc-23a1-4fbe-be79-1fede50a0fde tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.960s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:14.434759 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Successfully created port: 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:14.541923 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:14.545837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:14.546010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:14.546120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:14.546272 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:14.546395 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-89112bf9-47f7-4f6f-8f0d-57927969cd6e req-5e80a221-f574-49d9-87ba-f8f5fddb387d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state active and task_state None.
Jun 26 02:45:14.635685 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:14.821464 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:15.116177 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Successfully updated port: 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:15.194906 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:15.195367 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing instance network info cache due to event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:15.195632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:15.195831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:15.195982 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:15.217852 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:15.218127 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:15.381178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Found WWN 3300000005c7a197b for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:45:15.381332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:15.381656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== connect_volume: return (2859ms) {'type': 'block', 'scsi_wwn': '3300000005c7a197b', 'path': '/dev/dm-2', 'multipath_id': '3300000005c7a197b'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:15.381656 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c7a197b', 'path': '/dev/dm-2', 'multipath_id': '3300000005c7a197b'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:45:15.523767 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:15.524172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:15.525706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:15.526006 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:15.526100 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:15.526202 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No VIF found with MAC fa:16:3e:5b:34:5d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:15.618802 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:15.698316 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:15.720539 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:15.747979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:15.776587 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:15.831824 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:15.832655 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:15.832845 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating image(s)
Jun 26 02:45:15.833213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:15.833348 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:15.833742 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:15.834367 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:15.838951 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:15.839984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:15.888492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1022542784',id=27,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:03Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-wi38uuy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:03Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=4ee2c5e4-b366-4693-9031-41425bac0cab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:27:8f:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:15.888810 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "vif_mac": "fa:16:3e:27:8f:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:15.889756 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:15.891079 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:15.931294 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:15.931786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:15.933645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:15.934231 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:15.936844 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:15.937131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:15.956054 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:16.023174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:16.023582 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:16.041260 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Detaching volume 7cacc37a-9715-4bfb-9636-ac3b6f539b4d
Jun 26 02:45:16.076846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk 1073741824" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:16.077226 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:16.077683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:16.098927 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Attempting to driver detach volume 7cacc37a-9715-4bfb-9636-ac3b6f539b4d from mountpoint /dev/vdb
Jun 26 02:45:16.135719 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '159e9cea-d640-42ca-b93d-9f5b3cfc4ff3', 'attached_at': '', 'detached_at': '', 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'serial': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:45:16.139342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:16.140668 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:16.140837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Attempting to detach device vdb from instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <alias name="ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d"/>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <serial>7cacc37a-9715-4bfb-9636-ac3b6f539b4d</serial>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:16.141124 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:16.147216 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 from the persistent domain config.
Jun 26 02:45:16.147509 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] (1/8): Attempting to detach device vdb with device alias ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d from instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <alias name="ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d"/>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <serial>7cacc37a-9715-4bfb-9636-ac3b6f539b4d</serial>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:16.147809 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:16.162669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:16.163154 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:16.163450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:16.229673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.555s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:16.229673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:16.239273 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003645110000434215 future=<Future at 0x72e27c1f3da0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:16.239370 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:16.239489 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.6734813410000697 future=<Future at 0x72e27c28f500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:16.239653 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.67329726700018 future=<Future at 0x72e27c28f500 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:16.266659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:16.267032 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Cannot resize image /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:16.267376 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:16.267607 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:16.267894 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:16.269636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:16.269805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:16.394924 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <uuid>4ee2c5e4-b366-4693-9031-41425bac0cab</uuid>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <name>instance-0000001b</name>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1022542784</nova:name>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:11</nova:creationTime>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:user uuid="549e56d3a63947e894b5d6d92dd4eafa">tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member</nova:user>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:project uuid="5bb8ac3d99734c44bd220c90726dd72d">tempest-ServerBootFromVolumeStableRescueTest-1363934813</nova:project>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         <nova:port uuid="0582cc95-95b0-43fe-b8a4-737e34bdb240">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="serial">4ee2c5e4-b366-4693-9031-41425bac0cab</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="uuid">4ee2c5e4-b366-4693-9031-41425bac0cab</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <alias name="ua-b65cbaba-330c-4119-94ec-e7d911ba72f6"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-2"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <serial>b65cbaba-330c-4119-94ec-e7d911ba72f6</serial>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.rescue"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <boot order="1"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:27:8f:65"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <target dev="tap0582cc95-95"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/console.log" append="off"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:16.396489 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:16.404399 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance destroyed successfully.
Jun 26 02:45:16.460949 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d2266c8c-383f-4508-a1e5-298c0ea9bab1 req-792d5200-a495-4924-b5dd-2cad050275b0 service nova] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:16.461488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:16.461815 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:16.601207 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:16.601687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:16.602239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:16.602239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:16.602239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:16.602239 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b346156f-7e5e-42be-992d-d35f9f13d0a0 req-88dcb3b8-72be-4def-bec8-15eb7fe72e6d service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received unexpected event network-vif-plugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with vm_state active and task_state None.
Jun 26 02:45:16.666311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:16.737824 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:16.738066 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:16.738445 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:16.738779 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:16.742248 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441916.7419212, 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 => ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:45:16.743456 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7cacc37a-9715-4bfb-9636-ac3b6f539b4d for instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:45:16.746123 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 from the live domain config.
Jun 26 02:45:16.747603 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:45:16.747838 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:45:16.748017 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:45:16.748711 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x72e27c465310>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '159e9cea-d640-42ca-b93d-9f5b3cfc4ff3', 'attached_at': '', 'detached_at': '', 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'serial': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:45:16.748865 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.cryptsetup [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] closing encrypted volume /dev/dm-1 {{(pid=98991) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
Jun 26 02:45:16.783689 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:16.784093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:16.784305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:16.784720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:16.785048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:16.785198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:16.815331 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:16.815633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '57')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:16.815845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', '55')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:16.819936 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19a74f26e27346dc9badc9eb4476dfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94375dca8764ff8b335b461730d4cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:16.821884 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d', '54')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:16.822869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c27ec00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:16.823063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdd, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:16.823687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 330000000cd8782d1 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:16.864460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:16.921468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:16.970839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:16.970984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:16.972026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:16.984774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:16.985037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:16.999236 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.033707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.40.100,3260]
Jun 26 02:45:17.033707 np0000003683 nova-compute[98991]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:17.033707 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.039944 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:17.056077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.068053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.096703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c2a95146-75ea-4ccd-9764-2bacde4ad283 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.504s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:17.104042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.50.100,3260]
Jun 26 02:45:17.104042 np0000003683 nova-compute[98991]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-7cacc37a-9715-4bfb-9636-ac3b6f539b4d, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:17.104042 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.125798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:17.128327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:17.128451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (343ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:17.128638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:17.199459 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:17.246750 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:17.300444 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Successfully created port: e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:17.338234 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:17.682508 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:17.751468 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:17.813710 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Successfully updated port: e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:17.841012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:17.841243 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance network_info: |[{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:17.843082 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start _get_guest_xml network_info=[{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:17.847202 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:17.848426 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-597508233', uuid='d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb'), owner=OwnerMeta(userid='b7340727e31547a4b39299401535770d', username='tempest-AttachVolumeShelveTestJSON-100564320-project-member', projectid='8a7eadbb081143fb8f96d0187a0f7c09', projectname='tempest-AttachVolumeShelveTestJSON-100564320'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441917.8480632) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:17.849320 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:17.849709 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:17.850904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:17.851035 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:17.852021 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:17.852348 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:17.852507 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:17.852626 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:17.852723 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:17.852808 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:17.852890 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:17.853023 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:17.853115 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:17.853227 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:17.853334 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:17.853507 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:17.864643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvO1UHKROvy+5e2T1Ppg7iE9fMVkvTm1AL8Lz0UEpfobDil5CPz9RWu5Fcqtg+lxa0qxeI7Eo8xysl2p+txVpAb4hX8kx55VqbzJLsN42CSxsPBDT6c0nsE0pADs7dQag==',key_name='tempest-keypair-1639916074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:17.864857 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:17.865526 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:17.866274 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:17.883533 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-changed-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:17.883729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Refreshing instance network info cache due to event network-changed-e40d5f88-0578-4142-9adc-6e1db25f2f91. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:17.883929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] Acquiring lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:17.884049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] Acquired lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:17.884186 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Refreshing network info cache for port e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:17.926415 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:17.926568 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:17.926686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:17.926785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] No VIF found with MAC fa:16:3e:27:8f:65, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:17.927276 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Using config drive
Jun 26 02:45:18.331499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <uuid>d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</uuid>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <name>instance-0000001c</name>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-597508233</nova:name>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:17</nova:creationTime>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:user uuid="b7340727e31547a4b39299401535770d">tempest-AttachVolumeShelveTestJSON-100564320-project-member</nova:user>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:project uuid="8a7eadbb081143fb8f96d0187a0f7c09">tempest-AttachVolumeShelveTestJSON-100564320</nova:project>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         <nova:port uuid="8d73365b-ab16-4a51-8329-11ab8872174f">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="serial">d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="uuid">d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:0b:2f:b0"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <target dev="tap8d73365b-ab"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/console.log" append="off"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:18.369262 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Preparing to wait for external event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvO1UHKROvy+5e2T1Ppg7iE9fMVkvTm1AL8Lz0UEpfobDil5CPz9RWu5Fcqtg+lxa0qxeI7Eo8xysl2p+txVpAb4hX8kx55VqbzJLsN42CSxsPBDT6c0nsE0pADs7dQag==',key_name='tempest-keypair-1639916074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:18.370903 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:18.371377 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:18.371617 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:18.372099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.372421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:18.372746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:18.373610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.373821 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c8d85d-5715-5253-a197-c8a81af821d6', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:18.374644 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.375220 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:18.386114 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:18.393291 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.395716 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.395919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d73365b-ab, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:18.396293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d73365b-ab, col_values=(('qos', UUID('bff2a015-6f9d-4e27-a242-11b9b702172f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:18.396751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d73365b-ab, col_values=(('external_ids', {'iface-id': '8d73365b-ab16-4a51-8329-11ab8872174f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:2f:b0', 'vm-uuid': 'd3ee0b17-0238-4c17-b36d-5cc6e0e09dcb'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:18.397672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.399017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:18.408578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:18.409695 np0000003683 nova-compute[98991]: INFO os_vif [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab')
Jun 26 02:45:18.429693 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:18.448431 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:18.660345 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:18.689428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7b43b6f6-9979-4e97-ade6-91861fa0cc34 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:18.759746 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:18.760715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:18.761493 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Creating image(s)
Jun 26 02:45:18.761493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:18.761493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:18.761919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:18.762409 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:18.772775 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:18.773840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:18.878338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:18.878840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:18.879325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:18.881162 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:18.883534 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:18.883938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:18.935365 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:18.935572 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'keypairs' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:18.979185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:18.982547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:19.042870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk 1073741824" returned: 0 in 0.060s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:19.043491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:19.043950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:19.100457 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:19.101066 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:19.102950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:19.105606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:19.105606 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:19.105792 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-fc9997a5-e297-483f-b7af-3d0916f91c74 req-a319842a-c74b-4287-a5b3-992b3ccda9fc service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state active and task_state rescuing.
Jun 26 02:45:19.147272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:19.147884 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:19.148087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:19.164913 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e7a405ab-d106-41d3-8b0c-ff9e04f8dff4 req-58a1aff7-3fe0-4396-9dbc-fb881fd1bd72 service nova] Releasing lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:19.166343 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquired lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:19.166666 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:19.259172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:19.260639 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:19.261248 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:19.261438 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:19.261768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:19.262002 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:19.262159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:19.290232 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:19.290688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:19.290891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:19.291024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:19.291159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] No waiting events found dispatching network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:19.291313 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f554fc16-6b03-459f-824c-d46361f919a7 req-fa056fdc-e097-48e5-8d8e-492b511253db service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received unexpected event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 for instance with vm_state building and task_state spawning.
Jun 26 02:45:19.437985 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:19.441135 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:19.578555 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Creating config drive at /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config.rescue
Jun 26 02:45:19.582958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd061zzs_ {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:19.639197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd061zzs_" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:19.739221 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:19.913650 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0006086429998504173 future=<Future at 0x72e27c28f500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:19.915035 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441904.9128985, ddf5057b-2a8e-4974-934e-1f89155d50f5 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:19.915246 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:19.915695 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] VM Stopped (Lifecycle Event)
Jun 26 02:45:19.915950 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.13377449900008287 future=<Future at 0x72e27c2f1a60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:19.916062 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.1336299100000815 future=<Future at 0x72e27c2f1a60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:19.922762 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:19.924636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:19.924860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:19.925068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:19.925217 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:19.925364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:19.931740 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Terminating instance
Jun 26 02:45:19.936406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:19.936707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:19.938226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No VIF found with MAC fa:16:3e:0b:2f:b0, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:19.938998 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Using config drive
Jun 26 02:45:20.050470 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00033131599980151805 future=<Future at 0x72e27c2f1a60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:20.052001 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] Emitting event <LifecycleEvent: 1782441905.049632, 110dbeda-4ed0-4234-863e-7441034d8449 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:20.052001 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:20.052001 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] VM Stopped (Lifecycle Event)
Jun 26 02:45:20.054394 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.66627468899992 future=<Future at 0x72e27c2cf950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:20.054394 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.666135119000046 future=<Future at 0x72e27c2cf950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:20.092001 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.095428 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updating instance_info_cache with network_info: [{"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:20.102786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.138372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.141828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.233343 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.384878 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.390065 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.419129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5ef96bd2-2fc6-4f0f-9a45-eb4d01b33675 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: ddf5057b-2a8e-4974-934e-1f89155d50f5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:20.440018 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:20.448792 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:20.471150 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.474645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.500675 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.502355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.524511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.536377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:20.554638 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-995d58f4-50c6-460b-be12-19ff0e709753 tempest-TestMultiAttachVolumeSwap-1040529591 tempest-TestMultiAttachVolumeSwap-1040529591-project-member] [instance: 110dbeda-4ed0-4234-863e-7441034d8449] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:20.599499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Releasing lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:20.601545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance network_info: |[{"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:20.602267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Start _get_guest_xml network_info=[{"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:20.605213 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:20.606951 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-245535846', uuid='0ad2739b-fcd9-4c33-acb7-f8fb173e1923'), owner=OwnerMeta(userid='19a74f26e27346dc9badc9eb4476dfa1', username='tempest-AttachVolumeNegativeTest-918921231-project-member', projectid='a94375dca8764ff8b335b461730d4cdb', projectname='tempest-AttachVolumeNegativeTest-918921231'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441920.606444) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:20.608094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:20.608530 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:20.609458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:20.609717 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:20.610779 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:20.613755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:20.622879 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-245535846',display_name='tempest-AttachVolumeNegativeTest-server-245535846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-245535846',id=29,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqEbFErXEXrAH9vQwVLo/SlzbfhhqBigHGt/acHrViRaM56SZ73IwTHUpv711+1UJQrx3nSMxI8KL4esc/hKMn6d2Wc2pw0SLhzymseWZG4JYiyXuFrpSWghAeS8SfEsw==',key_name='tempest-keypair-950981941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-c97rahkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=0ad2739b-fcd9-4c33-acb7-f8fb173e1923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:20.623114 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:20.624001 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:20.624724 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:20.660337 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating config drive at /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config
Jun 26 02:45:20.664958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw91a1_j9 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:20.684501 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:20.684969 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:20.686247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:20.686247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:20.686247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] No waiting events found dispatching network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:20.686247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16bb465c-b829-4ea3-b009-c666e17b4751 req-a0b0fcb5-d4c9-472b-9b07-740b2a06a65b service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:20.725553 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw91a1_j9" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:20.868266 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999578115999839 future=<Future at 0x72e27c27ebd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:20.873225 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Instance destroyed successfully.
Jun 26 02:45:20.873745 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'resources' on Instance uuid 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:20.988586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 4ee2c5e4-b366-4693-9031-41425bac0cab due to new event <LifecycleEvent: 1782441920.98804, 4ee2c5e4-b366-4693-9031-41425bac0cab => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:45:20.988654 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441920.98804, 4ee2c5e4-b366-4693-9031-41425bac0cab => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:20.988792 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Resumed (Lifecycle Event)
Jun 26 02:45:20.995454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1aa2b5e7-597e-46b5-859b-a64502214e2b tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <uuid>0ad2739b-fcd9-4c33-acb7-f8fb173e1923</uuid>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <name>instance-0000001d</name>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeNegativeTest-server-245535846</nova:name>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:20</nova:creationTime>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:user uuid="19a74f26e27346dc9badc9eb4476dfa1">tempest-AttachVolumeNegativeTest-918921231-project-member</nova:user>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:project uuid="a94375dca8764ff8b335b461730d4cdb">tempest-AttachVolumeNegativeTest-918921231</nova:project>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         <nova:port uuid="e40d5f88-0578-4142-9adc-6e1db25f2f91">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="serial">0ad2739b-fcd9-4c33-acb7-f8fb173e1923</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="uuid">0ad2739b-fcd9-4c33-acb7-f8fb173e1923</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.config"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:f5:b8:6d"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <target dev="tape40d5f88-05"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/console.log" append="off"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:21.128636 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Preparing to wait for external event network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-245535846',display_name='tempest-AttachVolumeNegativeTest-server-245535846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-245535846',id=29,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqEbFErXEXrAH9vQwVLo/SlzbfhhqBigHGt/acHrViRaM56SZ73IwTHUpv711+1UJQrx3nSMxI8KL4esc/hKMn6d2Wc2pw0SLhzymseWZG4JYiyXuFrpSWghAeS8SfEsw==',key_name='tempest-keypair-950981941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-c97rahkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=0ad2739b-fcd9-4c33-acb7-f8fb173e1923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:21.131552 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:21.132125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.132883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.133275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:21.137840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.138618 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '321ff2a5-ebc6-52af-9caa-75c7cf017a73', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.140066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.141102 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:21.151068 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.156595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.156800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape40d5f88-05, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.157180 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape40d5f88-05, col_values=(('qos', UUID('047a0de8-13cd-4a94-b526-4fe470e6b9cf')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.157399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape40d5f88-05, col_values=(('external_ids', {'iface-id': 'e40d5f88-0578-4142-9adc-6e1db25f2f91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b8:6d', 'vm-uuid': '0ad2739b-fcd9-4c33-acb7-f8fb173e1923'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.159451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.160872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:21.177207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.178473 np0000003683 nova-compute[98991]: INFO os_vif [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05')
Jun 26 02:45:21.183001 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:21.183615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:21.184332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:21.184609 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:21.185089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:21.185219 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state rescued and task_state None.
Jun 26 02:45:21.185394 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:21.185648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:21.185863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:21.185984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:21.186357 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:21.186648 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state rescued and task_state None.
Jun 26 02:45:21.186800 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:21.187083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:21.187278 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:21.187441 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:21.187679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:21.187821 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-fc406c59-a870-4f4d-9b28-dac948fe3e32 req-65a847e3-de4f-458a-b9b6-bde5f157e74f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state rescued and task_state None.
Jun 26 02:45:21.262462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.306024 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.379372 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-390303236',display_name='tempest-TestEncryptedCinderVolumes-server-390303236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-390303236',id=23,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHlHTHBjIRmrJVZT5c/iIr5Uik/qUpPDtX6y4zCZeJaCsJqWX2ymyj6sAmU3fDbXK6AqGbdUVz1sohmpQ5Keoeh01zd07VEhRV+NGqsDElmhvWmak0PAYCxSmCzHQY4g==',key_name='tempest-keypair-698977925',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:25Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-5ptk2w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=159e9cea-d640-42ca-b93d-9f5b3cfc4ff3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:21.379574 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "842beb6d-eeb6-411e-b19a-827e327fe91e", "address": "fa:16:3e:c9:10:d3", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap842beb6d-ee", "ovs_interfaceid": "842beb6d-eeb6-411e-b19a-827e327fe91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:21.380331 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:21.380577 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:21.383896 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.383896 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap842beb6d-ee, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.386612 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:21.397559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.401277 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.401502 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cdcc273-c8dd-4cdf-bd4e-7e08df9965f9) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:21.403119 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.403266 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:21.411927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.416220 np0000003683 nova-compute[98991]: INFO os_vif [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:10:d3,bridge_name='br-int',has_traffic_filtering=True,id=842beb6d-eeb6-411e-b19a-827e327fe91e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842beb6d-ee')
Jun 26 02:45:21.416698 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Deleting instance files /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3_del
Jun 26 02:45:21.417698 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Deletion of /opt/stack/data/nova/instances/159e9cea-d640-42ca-b93d-9f5b3cfc4ff3_del complete
Jun 26 02:45:21.493927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:21.499005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:21.636127 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f103bb7e-2a59-4111-be5a-0310ad56e097 req-36a36b1d-1e48-42bf-9bf4-392fd23b90d4 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:21.636127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f103bb7e-2a59-4111-be5a-0310ad56e097 req-36a36b1d-1e48-42bf-9bf4-392fd23b90d4 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:21.636127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f103bb7e-2a59-4111-be5a-0310ad56e097 req-36a36b1d-1e48-42bf-9bf4-392fd23b90d4 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:21.636127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f103bb7e-2a59-4111-be5a-0310ad56e097 req-36a36b1d-1e48-42bf-9bf4-392fd23b90d4 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:21.636127 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f103bb7e-2a59-4111-be5a-0310ad56e097 req-36a36b1d-1e48-42bf-9bf4-392fd23b90d4 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Processing event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:21.638651 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.646922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.678518 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.684912 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:21.909199 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Unrescuing
Jun 26 02:45:21.909637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:21.909637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquired lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:21.909726 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:21.927598 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Took 1.49 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:21.928887 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:21.929226 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:21.929299 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:21.929554 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:22.010763 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:45:22.011161 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441922.0108395, 4ee2c5e4-b366-4693-9031-41425bac0cab => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:22.011320 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Started (Lifecycle Event)
Jun 26 02:45:22.032561 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:22.086921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:22.087698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:22.137037 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:22.143260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:22.144774 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance spawned successfully.
Jun 26 02:45:22.146114 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:22.416415 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:22.516788 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:22.522526 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:22.537904 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1cc448eb-15c6-4fdf-b6a9-f72c8be5cc42 req-3a9a2a5d-1661-4d9f-b7c9-fda896fc5405 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-deleted-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:22.538318 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-1cc448eb-15c6-4fdf-b6a9-f72c8be5cc42 req-3a9a2a5d-1661-4d9f-b7c9-fda896fc5405 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Neutron deleted interface 842beb6d-eeb6-411e-b19a-827e327fe91e; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:22.544274 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1cc448eb-15c6-4fdf-b6a9-f72c8be5cc42 req-3a9a2a5d-1661-4d9f-b7c9-fda896fc5405 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Detach interface failed, port_id=842beb6d-eeb6-411e-b19a-827e327fe91e, reason: Instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:22.588887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:22.651923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.654099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.654099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.654099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.654099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.654099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:22.702072 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:22.702184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:22.702288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:f5:b8:6d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:22.702751 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Using config drive
Jun 26 02:45:22.731083 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:22.732219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] Acquiring lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:22.732219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:22.732219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:22.732219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] No waiting events found dispatching network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:22.732219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-be607cd5-d7c9-40ec-ad2e-58236c6fde7c req-53c5e08e-5dd0-4af7-b6d9-667686380f99 service nova] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Received event network-vif-unplugged-842beb6d-eeb6-411e-b19a-827e327fe91e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:22.779201 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:22.927467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:22.948145 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating instance_info_cache with network_info: [{"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:22.976932 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:23.028282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:23.028459 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:23.029645 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:45:23.030245 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441923.0295746, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:23.030245 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Started (Lifecycle Event)
Jun 26 02:45:23.151704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:23.152168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:23.156661 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:23.156661 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Claim successful on node np0000003683
Jun 26 02:45:23.160648 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Took 7.33 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:23.161205 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:23.214929 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:23.345427 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Creating config drive at /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.config
Jun 26 02:45:23.349107 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvlhu0fer {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:23.394850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvlhu0fer" returned: 0 in 0.045s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:23.453497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Releasing lock "refresh_cache-4ee2c5e4-b366-4693-9031-41425bac0cab" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:23.454328 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'flavor' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:23.479337 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Took 1.55 seconds to deallocate network for instance.
Jun 26 02:45:23.532838 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:23.537124 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:23.541717 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:23.678057 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Took 12.94 seconds to build instance.
Jun 26 02:45:23.712363 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:23.712450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:23.712674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:23.712790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:23.712918 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:23.713032 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-99ef43fd-d9d5-4a12-bcad-55da9f61052b req-73983569-1e44-42d9-8358-5faf14f7372a service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received unexpected event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with vm_state active and task_state None.
Jun 26 02:45:23.719996 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0008155030000125407 future=<Future at 0x72e27c2cf950 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:23.720149 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:23.720535 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=12.147280993999857 future=<Future at 0x72e27c27ebd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:23.720668 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=12.1471152659999 future=<Future at 0x72e27c27ebd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:23.895281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:23.930463 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:23.990110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:23.990967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.005407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.028868 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.044352 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441924.0440202, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:24.044515 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Paused (Lifecycle Event)
Jun 26 02:45:24.105282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:24.182986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b569fcaf-54f7-45cb-9f2a-d449bde1335f tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.463s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:24.258245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.267546 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.271471 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.285335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:24.286188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:24.286188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:24.286188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:24.286188 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:24.286188 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ea6a265b-413a-433b-97b4-c02514457900 req-2c5bbb7e-e0c6-45ce-a78f-8126b31fe27f service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:45:24.297122 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.300840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.328071 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance destroyed successfully.
Jun 26 02:45:24.328590 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:24.353174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:24.353457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:24.445566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:24.546678 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:24.549196 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441924.5489616, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:24.549708 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Resumed (Lifecycle Event)
Jun 26 02:45:24.599493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.606221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:24.823037 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:24.823521 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing instance network info cache due to event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:24.823720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:24.823799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:24.823934 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:24.832776 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Object Instance<4ee2c5e4-b366-4693-9031-41425bac0cab> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:24.847676 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:24.847845 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:24.856000 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Detaching volume 65e6c2a2-e8cd-463e-81e0-ea24735a79d4
Jun 26 02:45:24.912493 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Attempting to driver detach volume 65e6c2a2-e8cd-463e-81e0-ea24735a79d4 from mountpoint /dev/vdb
Jun 26 02:45:24.916414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found disk vdb by alias ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:24.917728 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found disk vdb by alias ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:45:24.917847 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Attempting to detach device vdb from instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <alias name="ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4"/>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <serial>65e6c2a2-e8cd-463e-81e0-ea24735a79d4</serial>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:24.918076 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:24.923676 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully detached device vdb from instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 from the persistent domain config.
Jun 26 02:45:24.923943 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] (1/8): Attempting to detach device vdb with device alias ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 from instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <alias name="ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4"/>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <serial>65e6c2a2-e8cd-463e-81e0-ea24735a79d4</serial>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:45:24.924263 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:45:25.053222 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:25.057586 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:25.251511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.283693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.289543 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.325662 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:25.350451 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:25.385232 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.448682 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.448682 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:25.494210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 for instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:45:25.563375 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999742521000144 future=<Future at 0x72e27c35fd10 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:25.563597 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441925.5634005, 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:25.563717 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] VM Started (Lifecycle Event)
Jun 26 02:45:25.724354 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:25.859383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.707s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:25.860001 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:25.862566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.872s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:25.873611 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updated VIF entry in instance network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:45:25.873915 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:26.015500 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5656cd9c-c071-460d-ba96-fb7a9cd63572 req-0718d540-ad51-4e0b-822a-e81a931b07c7 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:26.015679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5656cd9c-c071-460d-ba96-fb7a9cd63572 req-0718d540-ad51-4e0b-822a-e81a931b07c7 service nova] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:26.015809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5656cd9c-c071-460d-ba96-fb7a9cd63572 req-0718d540-ad51-4e0b-822a-e81a931b07c7 service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:26.015909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5656cd9c-c071-460d-ba96-fb7a9cd63572 req-0718d540-ad51-4e0b-822a-e81a931b07c7 service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:26.017281 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5656cd9c-c071-460d-ba96-fb7a9cd63572 req-0718d540-ad51-4e0b-822a-e81a931b07c7 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Processing event network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:26.017281 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:26.022810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:26.035674 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance spawned successfully.
Jun 26 02:45:26.037175 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:26.066210 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:26.068796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:26.189767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-105a2217-4307-4981-a602-4bac1bee5125 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:26.366266 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:26.367631 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:26.367631 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:26.367931 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:26.375961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7bb8cf75-eb92-4bca-ac1f-3068b7fcbf44 req-68b542c0-fc6b-45c1-8237-b73b778e2360 service nova] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:26.380520 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:26.381198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:26.381198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:26.381198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:26.381198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:26.381505 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state active and task_state None.
Jun 26 02:45:26.381505 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:26.381685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:26.382067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:26.382181 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:26.382330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:26.382457 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state active and task_state None.
Jun 26 02:45:26.382644 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:26.382765 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:26.382919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:26.383071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:26.383181 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:26.383311 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-28b64b75-c527-46a1-9ee5-aa194ebb3ea4 req-10b4c586-7a68-431b-9657-6abc34501633 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received unexpected event network-vif-plugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with vm_state active and task_state None.
Jun 26 02:45:26.402797 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:26.471753 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a20c5b3a594daaacb7bef508d1ee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b07c33d4ed466ca32fa63a7e8b74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:26.488630 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:26.488906 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:26.547685 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.547873 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.548298 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.548962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.548962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.549230 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:26.571662 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:26.571806 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441926.5715728, 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:26.572796 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] VM Paused (Lifecycle Event)
Jun 26 02:45:26.685673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:26.873422 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Successfully created port: ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:26.876029 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:26.991696 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:27.060342 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Took 8.30 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:27.060751 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:27.074489 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:27.077063 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441927.0767024, 64f180a3-7b25-4094-bcd8-ee5c84773a01 => ua-65e6c2a2-e8cd-463e-81e0-ea24735a79d4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:45:27.077468 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441927.0771987, 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:27.077699 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] VM Resumed (Lifecycle Event)
Jun 26 02:45:27.081687 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully detached device vdb from instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 from the live domain config.
Jun 26 02:45:27.084857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:27.085234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:27.085596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:27.085885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:27.086299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:27.086490 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:27.115946 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4 (non-flash)
Jun 26 02:45:27.116244 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:27.116411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '57')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:27.116411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '56')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:27.117451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', '57')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:27.118326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c30d1c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'): ({'sdh'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:27.118571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Removing multipathed devices sdh, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:27.119147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flush multipath device 33000000058e30668 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:27.178381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:27.233880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:27.288918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:27.290219 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:27.290219 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:27.306382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:27.306382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:27.317010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.352295 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.40.100,3260]
Jun 26 02:45:27.352295 np0000003683 nova-compute[98991]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:27.352295 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.369888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.383049 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:27.388791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.430199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.50.100,3260]
Jun 26 02:45:27.430199 np0000003683 nova-compute[98991]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:27.430199 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.446837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:27.446837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:27.446837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== disconnect_volume: return (359ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:27.446837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:27.451741 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Successfully updated port: ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:27.498004 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.636s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:27.499910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.394s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:27.503523 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:27.503523 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Claim successful on node np0000003683
Jun 26 02:45:27.515128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-changed-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:27.515248 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Refreshing instance network info cache due to event network-changed-ff2ad29d-7b0f-4c47-a3d3-966e884feec6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:27.515390 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] Acquiring lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:27.515466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] Acquired lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:27.515612 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Refreshing network info cache for port ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:27.526060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:27.526278 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:27.526692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:27.526862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:27.526983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:27.532825 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Terminating instance
Jun 26 02:45:27.566970 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deleted allocations for instance 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3
Jun 26 02:45:27.572319 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Took 13.97 seconds to build instance.
Jun 26 02:45:27.580830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:27.585333 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:27.954424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:28.013127 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:28.017261 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:28.036634 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:28.073672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.076977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d4086ec5-8743-4c6a-907d-867bbf43bdb5 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.481s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.080973 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.086903 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 4ee2c5e4-b366-4693-9031-41425bac0cab due to new event <LifecycleEvent: 1782441928.0864289, 4ee2c5e4-b366-4693-9031-41425bac0cab => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:45:28.086903 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441928.0864289, 4ee2c5e4-b366-4693-9031-41425bac0cab => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:28.087237 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Resumed (Lifecycle Event)
Jun 26 02:45:28.100083 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:28.106226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.134151 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:28.134514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.134758 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.134963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.135341 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] No waiting events found dispatching network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:28.135711 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-98a265de-34de-4732-b8a7-b0a8aecab9a6 req-64f6cf5c-4e3e-4c49-8139-7c5b91ef581f service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received unexpected event network-vif-plugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 for instance with vm_state active and task_state None.
Jun 26 02:45:28.248435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.254836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.315790 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:28.367927 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Instance destroyed successfully.
Jun 26 02:45:28.368715 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid 4ee2c5e4-b366-4693-9031-41425bac0cab {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:28.393074 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:28.395102 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:28.395102 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Creating image(s)
Jun 26 02:45:28.397400 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.397400 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.397919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.398739 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:28.405392 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:28.411744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:28.471075 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:28.471767 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.472031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.472216 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.472417 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:28.472624 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:28.472796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:28.472960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Acquiring lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.473184 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.473982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.474159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] No waiting events found dispatching network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:28.474798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d1bf174-f0f0-4353-9869-fac836a6c9c3 req-da999cfc-bc41-4484-b0c8-e07b07dad377 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-unplugged-0582cc95-95b0-43fe-b8a4-737e34bdb240 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:28.517791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:28.519898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.520614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.521943 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:28.527010 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:28.527601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:28.572502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.572502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.587178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1d7d292f-2231-453f-9bce-04e838db05fc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "159e9cea-d640-42ca-b93d-9f5b3cfc4ff3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.662s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.592989 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:28.598508 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441928.5974436, 4ee2c5e4-b366-4693-9031-41425bac0cab => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:28.598508 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Started (Lifecycle Event)
Jun 26 02:45:28.634469 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:28.634836 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:28.685102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk 1073741824" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:28.685579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.685917 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:28.766362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:28.766721 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:28.766912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:28.821613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2893b4c2-bf62-44b1-a4ed-1f23166a5d79 req-eaf96ab0-0d21-477d-ad8a-f57bdcd251a2 service nova] Releasing lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:28.822496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:28.822867 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:28.857964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:28.858312 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Cannot resize image /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:28.858709 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:28.858968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Ensure instance console log exists: /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:28.859211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:28.859444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:28.859698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:28.873120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1022542784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1022542784',id=27,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:20Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-wi38uuy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:26Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=4ee2c5e4-b366-4693-9031-41425bac0cab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:28.873343 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "address": "fa:16:3e:27:8f:65", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0582cc95-95", "ovs_interfaceid": "0582cc95-95b0-43fe-b8a4-737e34bdb240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:28.874096 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:28.874575 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:28.876452 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.876786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0582cc95-95, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:28.877907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.878693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:28.879077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.879751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.879895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2f20cb6-09a9-4306-8aba-7998d13fb48d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:28.880305 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.880853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:28.881030 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:28.884587 np0000003683 nova-compute[98991]: INFO os_vif [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=0582cc95-95b0-43fe-b8a4-737e34bdb240,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0582cc95-95')
Jun 26 02:45:28.888107 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:28.888514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:28.888707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:28.889084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:28.889452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b65cbaba-330c-4119-94ec-e7d911ba72f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:28.889623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:28.913931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:28.913931 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:28.913931 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:28.913931 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:28.913931 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:28.914226 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:28.914226 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:28.914226 np0000003683 nova-compute[98991]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:28.914226 np0000003683 nova-compute[98991]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6 (non-flash)
Jun 26 02:45:28.914226 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:28.914396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:28.914532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '52')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:28.915699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6', '53')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:28.916650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c2e3c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:28.916919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Removing multipathed devices sdb, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:28.917187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flush multipath device 3300000005c7a197b {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:28.974274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:29.018931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:29.021060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a7fb2df6-44a7-42ff-a551-cc87402b4861 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.667s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:29.022355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.578s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:29.023548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:29.023548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:29.023548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:29.025634 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Terminating instance
Jun 26 02:45:29.077838 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:29.079635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking to see if SCSI volumes sdb, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:29.079974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] SCSI volumes sdb, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:29.080823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking to see if device paths {'sdb', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:29.094233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Device paths {'sdb', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:29.094233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:29.103995 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:29.111601 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999729928000079 future=<Future at 0x72e2ad2f9880 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:29.115289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.139917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:29.140166 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:29.150721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.40.100,3260]
Jun 26 02:45:29.150721 np0000003683 nova-compute[98991]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:29.150721 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.165238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.174102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.213932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.50.100,3260]
Jun 26 02:45:29.213932 np0000003683 nova-compute[98991]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-b65cbaba-330c-4119-94ec-e7d911ba72f6, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:29.213932 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.228274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:29.228562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:29.228745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== disconnect_volume: return (340ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:29.228971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:29.229704 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Deleting instance files /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab_del
Jun 26 02:45:29.230219 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Deletion of /opt/stack/data/nova/instances/4ee2c5e4-b366-4693-9031-41425bac0cab_del complete
Jun 26 02:45:29.394377 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:29.530162 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:29.553581 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.559186 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:29.565093 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.578869 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.585007 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.604135 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.608866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:29.643242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:29.644426 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:29.739687 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:29.740317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:29.740530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:29.740686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:29.740832 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] No waiting events found dispatching network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:29.740966 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a7469174-3ad1-44ac-afdc-4e62569645c0 req-b68aad70-aedc-4d27-a62d-587b509bf728 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:29.742267 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Took 1.71 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:29.743155 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:29.743727 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:29.744048 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:29.744313 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:29.767468 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Updating instance_info_cache with network_info: [{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:29.817764 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:29.887876 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999656540999922 future=<Future at 0x72e27c4a9040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:29.889679 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Instance destroyed successfully.
Jun 26 02:45:29.890203 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'resources' on Instance uuid 64f180a3-7b25-4094-bcd8-ee5c84773a01 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:30.122239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-66befa77-82fa-45b4-a3f0-045d0233c6bc req-8d170451-d211-4037-976e-d551c88bbcd7 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Received event network-vif-deleted-0582cc95-95b0-43fe-b8a4-737e34bdb240 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:30.122737 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-66befa77-82fa-45b4-a3f0-045d0233c6bc req-8d170451-d211-4037-976e-d551c88bbcd7 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Neutron deleted interface 0582cc95-95b0-43fe-b8a4-737e34bdb240; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:30.124202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-66befa77-82fa-45b4-a3f0-045d0233c6bc req-8d170451-d211-4037-976e-d551c88bbcd7 service nova] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Detach interface failed, port_id=0582cc95-95b0-43fe-b8a4-737e34bdb240, reason: Instance 4ee2c5e4-b366-4693-9031-41425bac0cab could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:30.158460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.659s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:30.159070 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:30.161424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.518s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:30.168268 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:30.168449 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Claim successful on node np0000003683
Jun 26 02:45:30.189087 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-changed-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:30.189613 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Refreshing instance network info cache due to event network-changed-e40d5f88-0578-4142-9adc-6e1db25f2f91. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:30.189613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] Acquiring lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:30.189613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] Acquired lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:30.189613 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Refreshing network info cache for port e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:30.269691 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:30.270072 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance network_info: |[{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:30.272098 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start _get_guest_xml network_info=[{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:30.274579 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:30.275938 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1145245523', uuid='121ec5e6-08cf-4e0c-9c89-e2be23a274be'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441930.2755597) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:30.276910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:30.277293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:30.278437 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:30.278741 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:30.279736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:30.280055 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:30.280200 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:30.281209 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:30.292561 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1145245523',display_name='tempest-ServerRescueNegativeTestJSON-server-1145245523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1145245523',id=30,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-o4z3j5hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:27Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=121ec5e6-08cf-4e0c-9c89-e2be23a274be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:30.292821 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:30.293183 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:30.293703 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:30.392320 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1002734930',display_name='tempest-VolumesSnapshotTestJSON-instance-1002734930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1002734930',id=24,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINIwz/bwbpRwyfTyrZChQJd9pJdEhn1Rpzs/GCt8L6cAbFR13JmNPIeWhs39Vx0VcW5gwrZ1wQrTGULyylA3HjIi2PtegGXQjoXY341MTwFxt7kNJS6sIiXwFk9RHOAkw==',key_name='tempest-keypair-65515740',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:28Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-hbht09fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=64f180a3-7b25-4094-bcd8-ee5c84773a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:30.392590 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "address": "fa:16:3e:5b:34:5d", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2ddd75-1e", "ovs_interfaceid": "ed2ddd75-1e38-44e0-8e46-ee03d596a1cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:30.393011 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:30.393236 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:30.394179 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.394399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped2ddd75-1e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.403553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.403553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:30.403553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.403876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.404025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d08d6bc-2cbc-4d9f-abbe-96dc6a7057df) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.405282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.405282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:30.405282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.406858 np0000003683 nova-compute[98991]: INFO os_vif [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:34:5d,bridge_name='br-int',has_traffic_filtering=True,id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2ddd75-1e')
Jun 26 02:45:30.407981 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:30.408238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:30.408413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:30.408750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:30.409021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:30.409154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:30.430239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:30.430239 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:30.430239 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:30.430396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:30.430396 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:30.430396 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:30.430615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:30.430748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:30.430885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:45:30.431022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:30.431157 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65e6c2a2-e8cd-463e-81e0-ea24735a79d4') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:45:30.431311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c454720>, {}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:30.431466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Disconnecting from: [] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:30.431708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.023s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:30.431851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== disconnect_volume: return (23ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:30.432014 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:30.432327 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Deleting instance files /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01_del
Jun 26 02:45:30.433263 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Deletion of /opt/stack/data/nova/instances/64f180a3-7b25-4094-bcd8-ee5c84773a01_del complete
Jun 26 02:45:30.574544 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:30.666253 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:30.666416 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:30.666709 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:30.666904 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:30.691602 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:30.772682 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a20c5b3a594daaacb7bef508d1ee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b07c33d4ed466ca32fa63a7e8b74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <uuid>121ec5e6-08cf-4e0c-9c89-e2be23a274be</uuid>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <name>instance-0000001e</name>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1145245523</nova:name>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:30</nova:creationTime>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         <nova:port uuid="ff2ad29d-7b0f-4c47-a3d3-966e884feec6">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="serial">121ec5e6-08cf-4e0c-9c89-e2be23a274be</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="uuid">121ec5e6-08cf-4e0c-9c89-e2be23a274be</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e5:78:7d"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <target dev="tapff2ad29d-7b"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/console.log" append="off"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:30.801053 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Preparing to wait for external event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1145245523',display_name='tempest-ServerRescueNegativeTestJSON-server-1145245523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1145245523',id=30,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-o4z3j5hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:27Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=121ec5e6-08cf-4e0c-9c89-e2be23a274be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:30.803820 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.804198 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.804198 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:30.805311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.805569 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49b8c2f7-1b11-577e-b89a-278fbcb16768', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.807447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.807447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:30.808982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.813409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.816335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff2ad29d-7b, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.816335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff2ad29d-7b, col_values=(('qos', UUID('85ce3d16-287e-497e-bb92-8c63821ce443')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.816335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff2ad29d-7b, col_values=(('external_ids', {'iface-id': 'ff2ad29d-7b0f-4c47-a3d3-966e884feec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:78:7d', 'vm-uuid': '121ec5e6-08cf-4e0c-9c89-e2be23a274be'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:30.816335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.817376 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:30.822870 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:30.824216 np0000003683 nova-compute[98991]: INFO os_vif [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b')
Jun 26 02:45:30.941286 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:30.942094 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:30.942356 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:30.942462 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:30.942759 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:31.075695 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:31.078144 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Took 1.33 seconds to deallocate network for instance.
Jun 26 02:45:31.103793 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:31.168799 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:31.292277 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Successfully created port: 56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:31.311789 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updated VIF entry in instance network info cache for port e40d5f88-0578-4142-9adc-6e1db25f2f91. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:45:31.312109 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updating instance_info_cache with network_info: [{"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:31.644692 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 02:45:31.645795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Deleting volume: b65cbaba-330c-4119-94ec-e7d911ba72f6 {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:45:31.674625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:31.688241 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:31.800015 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:31.800187 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:31.814805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:31.815104 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] Acquiring lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:31.815376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:31.816048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a44944d-a377-4959-b9d3-50fb5352d1ba req-90ad279c-682d-4cb9-9522-651aac5fb19b service nova] Releasing lock "refresh_cache-0ad2739b-fcd9-4c33-acb7-f8fb173e1923" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:31.816487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:31.816692 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] No waiting events found dispatching network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:31.816808 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-unplugged-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:31.816907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Received event network-vif-deleted-ed2ddd75-1e38-44e0-8e46-ee03d596a1cc {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:31.817008 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Neutron deleted interface ed2ddd75-1e38-44e0-8e46-ee03d596a1cc; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:31.818501 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9a60dc77-c0ed-4c96-90fd-8e6beb3e8429 req-d4f30df6-552e-4fd6-94dc-ffb42fac2fc3 service nova] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Detach interface failed, port_id=ed2ddd75-1e38-44e0-8e46-ee03d596a1cc, reason: Instance 64f180a3-7b25-4094-bcd8-ee5c84773a01 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:31.834532 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Successfully updated port: 56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:32.019007 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:32.185662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:32.255898 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-changed-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:32.256036 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Refreshing instance network info cache due to event network-changed-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:32.256166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] Acquiring lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:32.256364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] Acquired lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:32.256415 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Refreshing network info cache for port 56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:32.302601 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:32.336651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:32.345498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:32.345678 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:32.345751 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:e5:78:7d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:32.346102 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Using config drive
Jun 26 02:45:32.520735 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Took 1.58 seconds to deallocate network for instance.
Jun 26 02:45:32.543230 np0000003683 nova-compute[98991]: WARNING nova.volume.cinder [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Attachment b8e7ae75-b6b8-46b8-896a-fc0297ceb179 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b8e7ae75-b6b8-46b8-896a-fc0297ceb179. (HTTP 404) (Request-ID: req-202dbc3a-a8e3-4e6d-82f9-709e3c4fcf4e)
Jun 26 02:45:32.543626 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Took 0.02 seconds to detach 1 volumes for instance.
Jun 26 02:45:32.681764 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:32.682995 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:32.683260 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Creating image(s)
Jun 26 02:45:32.683753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:32.683952 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:32.684592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:32.685211 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:32.689013 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:32.693500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:32.761656 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:32.794050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:32.794491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:32.795010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:32.795492 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:32.798543 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:32.798965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:32.816502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.652s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:32.816502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:32.819961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.634s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:32.837245 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:32.857054 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:32.900645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:32.901866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:32.963813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk 1073741824" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:32.963813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:32.963813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:33.056307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:33.065560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:33.067094 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:33.067094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:33.104066 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Creating config drive at /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config
Jun 26 02:45:33.108356 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:33.114988 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdbe048v7 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:33.169636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:33.169986 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Cannot resize image /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:33.170316 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:33.170499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Ensure instance console log exists: /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:33.170793 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:33.170980 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:33.172241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:33.180223 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdbe048v7" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:33.324210 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:33.324669 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:33.324991 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:33.325353 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:33.436796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:33.437271 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:33.596280 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ba91ef3eaa94fcf8f4627a6d0d37c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e8df8f519e47eeba096968739cfd68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:33.612075 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:33.612832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c3ac588-f6b1-4884-9544-2af948348236 req-e7919fa1-e9e7-4447-ad1b-259c64228ba8 service nova] Releasing lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:33.613157 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:33.614591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:33.614800 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:33.623544 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.658858 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.661052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.736539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.833007 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:33.939804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:33.956219 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.961418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.968665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.968665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:33.991072 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:34.059336 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully created port: 4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:34.117505 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:34.182245 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:34.319028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:34.319276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:34.319457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:34.319671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:34.319822 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Processing event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:34.320218 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:34.320384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:34.320574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:34.320695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:34.320845 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:34.320986 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a8cb98ea-03a0-4518-826a-2299de4ec2ae req-e3365817-57da-487a-86b6-6a3c85eecf25 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state building and task_state spawning.
Jun 26 02:45:34.375675 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:34.464165 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441934.4638326, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:34.464300 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Started (Lifecycle Event)
Jun 26 02:45:34.466764 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:34.469114 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully created port: c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:34.471243 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:34.473859 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance spawned successfully.
Jun 26 02:45:34.474206 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:34.512878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:34.558092 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Updating instance_info_cache with network_info: [{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:34.627890 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.808s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:34.629341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.572s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:34.681851 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Deleted allocations for instance 4ee2c5e4-b366-4693-9031-41425bac0cab
Jun 26 02:45:34.854790 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully created port: 58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:34.970297 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:34.972093 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:34.982894 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:34.983119 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:34.983390 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:34.983666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:34.983914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:34.984185 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:35.060127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:35.061065 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance network_info: |[{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:35.063589 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start _get_guest_xml network_info=[{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:35.069620 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:35.071233 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1997991914', uuid='266d20a5-b882-4896-9d47-a60855b80312'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441935.0707483) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:35.079832 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:35.084110 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:35.086184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:35.086457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:35.087710 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:35.088340 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:35.088558 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:35.088695 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:35.088864 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:35.088972 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:35.089099 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:35.089277 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:35.089403 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:35.089574 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:35.089706 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:35.089900 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:35.106674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1997991914',display_name='tempest-ServerRescueNegativeTestJSON-server-1997991914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1997991914',id=31,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-45b7r4od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:32Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=266d20a5-b882-4896-9d47-a60855b80312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:35.106904 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:35.107626 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:35.108336 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:35.336441 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully created port: f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:35.348507 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:35.348691 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:35.350268 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:35.474775 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:35.475330 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441935.4747908, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:35.475330 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Paused (Lifecycle Event)
Jun 26 02:45:35.489407 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Took 7.10 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:35.489731 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <uuid>266d20a5-b882-4896-9d47-a60855b80312</uuid>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <name>instance-0000001f</name>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1997991914</nova:name>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:35</nova:creationTime>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         <nova:port uuid="56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="serial">266d20a5-b882-4896-9d47-a60855b80312</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="uuid">266d20a5-b882-4896-9d47-a60855b80312</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:de:90:2e"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <target dev="tap56b20aa7-5a"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/console.log" append="off"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Preparing to wait for external event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:35.611814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:35.613907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:35.613907 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1997991914',display_name='tempest-ServerRescueNegativeTestJSON-server-1997991914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1997991914',id=31,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-45b7r4od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:32Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=266d20a5-b882-4896-9d47-a60855b80312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:35.613907 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:35.613907 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:35.613907 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:35.614887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.615345 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:35.615737 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:35.617023 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.617249 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c95840a-8004-5493-893c-a7ae351d5936', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:35.618280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.619467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:35.619662 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.623450 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.623772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56b20aa7-5a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:35.624240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56b20aa7-5a, col_values=(('qos', UUID('120e63a0-22d9-4d1c-b605-2b150140a287')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:35.624430 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56b20aa7-5a, col_values=(('external_ids', {'iface-id': '56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:90:2e', 'vm-uuid': '266d20a5-b882-4896-9d47-a60855b80312'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:35.625467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.626898 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:35.632270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:35.633421 np0000003683 nova-compute[98991]: INFO os_vif [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a')
Jun 26 02:45:35.701230 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-118647fc-80b2-42d5-90f8-fb6ee66f9475 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "4ee2c5e4-b366-4693-9031-41425bac0cab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.173s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:35.762521 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully created port: 92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:35.854296 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:35.860267 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Booting with volume b445d202-d2f5-44ff-8efc-5cb55da9ea0c at /dev/vda
Jun 26 02:45:35.869501 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004071580001436814 future=<Future at 0x72e27c27ebd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.869703 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.870251 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Emitting event <LifecycleEvent: 1782441920.8676996, 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:35.870251 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.692889319999949 future=<Future at 0x72e27c35fd10 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.870446 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] VM Stopped (Lifecycle Event)
Jun 26 02:45:35.871579 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.691511336000076 future=<Future at 0x72e27c35fd10 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.872205 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.872205 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.23299613800009 future=<Future at 0x72e2ad2f9880 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.872205 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.232921559000033 future=<Future at 0x72e2ad2f9880 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:35.917654 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:35.930141 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:45:35.951745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:35.979587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:35.985050 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441935.9846249, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:35.985224 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Resumed (Lifecycle Event)
Jun 26 02:45:35.990669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:45:35.991375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:45:36.001128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:45:36.002367 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:feec:5126', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fee5:787d', 'fe80::2c1d:27ff:fe1e:8bcc'] 
Jun 26 02:45:36.002501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:45:36.002633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:45:36.002903 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:36.003089 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating existing volume attachment record: 5a0ef5ca-0839-4d80-b87c-39516402ce0f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:45:36.007153 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Took 12.91 seconds to build instance.
Jun 26 02:45:36.324724 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: 4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:36.367173 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.739s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:36.369487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.855s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:36.372385 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:36.372557 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Claim successful on node np0000003683
Jun 26 02:45:36.375296 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 159e9cea-d640-42ca-b93d-9f5b3cfc4ff3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:36.382565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:36.382784 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-4c428988-ac19-4dba-8540-640346338513. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:36.383065 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:36.383200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:36.383368 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port 4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:36.427668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:36.427804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:36.427976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:36.428086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:36.428228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:36.430198 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Terminating instance
Jun 26 02:45:36.435865 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Deleted allocations for instance 64f180a3-7b25-4094-bcd8-ee5c84773a01
Jun 26 02:45:36.488346 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:36.489945 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:36.509860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.422s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:36.690459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:36.885386 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:36.934067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:36.956813 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:36.964371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:36.969496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:36.994850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.133697 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.147372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.157566 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:37.166061 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:37.166388 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:37.166648 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:de:90:2e, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:37.167733 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Using config drive
Jun 26 02:45:37.235800 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:37.236428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:37.236428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:37.236428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:37.236655 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] No waiting events found dispatching network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:37.236869 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e2b49da-cc9c-4a1c-80b2-d5e5a059ef26 req-d4ea2fd7-9687-494e-b195-2984fd3d5c5a service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:37.285806 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999590377999994 future=<Future at 0x72e27c4b9f10 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:37.286696 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Instance destroyed successfully.
Jun 26 02:45:37.287093 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid 716bc480-bbf9-4921-8f5e-d382bf7100ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:37.449753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4abcf091-1687-48d6-8713-f4a8377db6d9 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "64f180a3-7b25-4094-bcd8-ee5c84773a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.427s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:37.648838 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Booting with volume 375eb09e-23f6-4946-983f-f6c7ca89d076 at /dev/vdb
Jun 26 02:45:37.661628 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a385497a-70e9-498a-9470-0d9031828b77 req-d74f84eb-021f-4110-add2-3e1c080ef44d service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:37.675691 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:37.699450 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:37.710624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:45:37.721598 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:37.742571 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:37.794896 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:44:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1331979031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-1331979031',id=25,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:33Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-3s3wi4xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:41Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=716bc480-bbf9-4921-8f5e-d382bf7100ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:37.795549 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "address": "fa:16:3e:ec:51:26", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc941df-aa", "ovs_interfaceid": "dfc941df-aa6d-462e-a829-5458ef1d90ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:37.796920 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:37.797651 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:37.798198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:45:37.798446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:45:37.803825 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.804144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc941df-aa, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:37.809995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.811522 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:45:37.813119 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fee5:787d', 'fe80::2c1d:27ff:fe1e:8bcc'] 
Jun 26 02:45:37.813237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:45:37.813390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:45:37.814138 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:37.814631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.815202 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating existing volume attachment record: 4882f643-ff54-474b-8458-aaab51e41f25 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:45:37.820267 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.820467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fb9d6b9-eceb-49e7-91df-eba281255e58) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:37.825035 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.828003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:37.832160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:37.834264 np0000003683 nova-compute[98991]: INFO os_vif [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:51:26,bridge_name='br-int',has_traffic_filtering=True,id=dfc941df-aa6d-462e-a829-5458ef1d90ca,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc941df-aa')
Jun 26 02:45:37.837465 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Deleting instance files /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed_del
Jun 26 02:45:37.837465 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Deletion of /opt/stack/data/nova/instances/716bc480-bbf9-4921-8f5e-d382bf7100ed_del complete
Jun 26 02:45:37.857252 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Creating config drive at /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config
Jun 26 02:45:37.860523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt3wb2t8b {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:37.921224 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt3wb2t8b" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:38.065184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:38.065413 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:38.347537 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:38.347961 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:38.348222 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:38.348319 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:38.348637 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:38.356822 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:38.394720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:38.449128 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:38.502672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:38.549189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:38.551311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:38.569731 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:38.776403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-709b099f-bd5e-47a9-aacd-272907d48b5d req-168d461b-1746-4062-a636-797e921ee78b service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-deleted-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:38.779154 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-709b099f-bd5e-47a9-aacd-272907d48b5d req-168d461b-1746-4062-a636-797e921ee78b service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Neutron deleted interface dfc941df-aa6d-462e-a829-5458ef1d90ca; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:38.783453 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-709b099f-bd5e-47a9-aacd-272907d48b5d req-168d461b-1746-4062-a636-797e921ee78b service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Detach interface failed, port_id=dfc941df-aa6d-462e-a829-5458ef1d90ca, reason: Instance 716bc480-bbf9-4921-8f5e-d382bf7100ed could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:38.824992 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: 4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:38.880721 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:38.881746 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:38.881932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:38.882028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:38.882122 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port 4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:39.082631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.715s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:39.083259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:39.221164 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:39.292500 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441939.2920535, 266d20a5-b882-4896-9d47-a60855b80312 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:39.292720 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Started (Lifecycle Event)
Jun 26 02:45:39.300762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:39.302712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Acquiring lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:39.302891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:39.304544 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:39.304725 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] No waiting events found dispatching network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:39.304860 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Received event network-vif-unplugged-dfc941df-aa6d-462e-a829-5458ef1d90ca for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:39.304983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:39.305108 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:39.305257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:39.388387 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:39.450891 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:39.469345 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Booting with volume 0ec19119-f855-41bf-a3dc-452f25bc62c7 at /dev/vdc
Jun 26 02:45:39.512052 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:39.526546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:45:39.547450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:39.593334 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:39.593574 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:39.597066 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:39.597496 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:39.600019 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:45:39.600681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:45:39.611792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:45:39.613533 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0', 'fe80::fc16:3eff:fe8a:e181', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fee5:787d', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e'] 
Jun 26 02:45:39.613671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:45:39.613812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:45:39.614096 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:39.614329 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating existing volume attachment record: 5088add7-9f4b-4abe-b4ea-d08b6d7c89fc {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:45:39.634229 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:39.675775 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13af0bfb96bf40179144f66af7baeed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419e029cdd744c1598f7a9d2bcc52340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:39.722620 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Took 1.37 seconds to deallocate network for instance.
Jun 26 02:45:39.800373 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:39.810043 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441939.808962, 266d20a5-b882-4896-9d47-a60855b80312 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:39.810043 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Paused (Lifecycle Event)
Jun 26 02:45:39.869749 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:40.098846 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:40.136191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9b9bac36-f384-4a96-83f1-8dc54dd51d87 req-3218007c-cccf-477b-9eb8-a6daff31b871 service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:40.140424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:40.140424 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:40.193428 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Successfully created port: 666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:40.229289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:40.229289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:40.312230 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:40.313916 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:40.604706 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:40.641579 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:40.756858 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Successfully updated port: 666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:40.763202 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:40.816449 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:40.835327 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:40.835692 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-c7c33687-ea16-4c3a-a1cf-e5ab51039f82. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:40.835741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:40.851923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:40.852451 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:40.924559 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:40.931075 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: 58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:41.260682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:41.260778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:41.260894 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:41.355107 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:41.383930 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:41.384055 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-58eb4121-75dd-45b6-a7bd-34b53605d00d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:41.384197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:41.426143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:41.426369 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:41.426656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:41.426832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:41.426970 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.427108 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Processing event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:41.427273 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:41.427402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:41.427589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:41.427724 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.428376 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:41.428663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:41.429136 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] No waiting events found dispatching network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:41.429401 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:41.430288 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-202bece2-7e3f-4a09-8018-480b7b6aa2a8 req-28f24813-20e0-4b98-b959-29df552e6fa1 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received unexpected event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 for instance with vm_state building and task_state spawning.
Jun 26 02:45:41.430913 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441941.4306946, 266d20a5-b882-4896-9d47-a60855b80312 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:41.431053 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Resumed (Lifecycle Event)
Jun 26 02:45:41.432271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:41.438085 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance spawned successfully.
Jun 26 02:45:41.439106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:41.614972 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:41.614972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:41.615213 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Creating image(s)
Jun 26 02:45:41.615598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:41.615792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:41.616424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.617810 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:41.621416 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:41.623871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:41.691270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:41.709239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:41.709831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:41.710318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:41.710762 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:41.717254 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:41.717254 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:41.771665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:41.774179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:41.774179 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Creating image(s)
Jun 26 02:45:41.774179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:45:41.774179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Ensure instance console log exists: /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:41.774842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:41.775383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:41.775892 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.815262 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:41.815961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:41.847909 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:41.864512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.634s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.881962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk 1073741824" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:41.883903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:41.883903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:41.934627 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:41.940941 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:41.952892 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:41.955805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:41.968275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.968759 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.969305 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.969991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.970393 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.970799 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:41.975419 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Deleted allocations for instance 716bc480-bbf9-4921-8f5e-d382bf7100ed
Jun 26 02:45:41.992809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:41.993196 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:41.993835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:42.032587 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:42.111916 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:42.112318 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Cannot resize image /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:42.112702 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:42.112891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Ensure instance console log exists: /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:42.113171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:42.113414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:42.113604 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:42.116622 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:42.222038 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:42.280533 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updating instance_info_cache with network_info: [{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:42.476220 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:42.480361 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Took 9.80 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:42.483805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:42.724860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:42.724860 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-changed-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:42.724860 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Refreshing instance network info cache due to event network-changed-666aadbc-06be-4326-beab-7ac3be314c7e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:42.725012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Acquiring lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:42.726760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:42.726760 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port 58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:42.782994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:42.783324 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Instance network_info: |[{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:42.783832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Acquired lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:42.785610 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Refreshing network info cache for port 666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:42.786807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Start _get_guest_xml network_info=[{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:42.792781 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:42.793979 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1861734872', uuid='cbc4f091-0c51-441b-95b4-6730199b1bf8'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441942.7936316) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:42.796842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:42.797390 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:42.799544 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:42.799747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:42.803030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:42.805258 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:42.815203 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1861734872',display_name='tempest-TestEncryptedCinderVolumes-server-1861734872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1861734872',id=33,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61tIYnzWeAHCeCx1WZ80Q2BjiKlbZwqrxx/d0zmGuS8dLCJwgQ8tehMkF0/URT6wsdynNZRc4rVqNJty5b2TRC+FcE4Peis5BPKJDEJjuk06j4J1giME4HhyvlL9Aluw==',key_name='tempest-keypair-1815078964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-8yoaw3ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=cbc4f091-0c51-441b-95b4-6730199b1bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:42.815419 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:42.815901 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:42.816421 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'pci_devices' on Instance uuid cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:42.828126 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:42.987268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-35d1c49d-3fa7-41c3-a358-12fd939d65ad tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "716bc480-bbf9-4921-8f5e-d382bf7100ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.559s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:42.999577 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Took 18.96 seconds to build instance.
Jun 26 02:45:43.049591 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Successfully updated port: 92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:43.132402 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:43.132819 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:43.133258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:43.228465 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:43.289187 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <uuid>cbc4f091-0c51-441b-95b4-6730199b1bf8</uuid>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <name>instance-00000021</name>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1861734872</nova:name>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:42</nova:creationTime>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         <nova:port uuid="666aadbc-06be-4326-beab-7ac3be314c7e">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="serial">cbc4f091-0c51-441b-95b4-6730199b1bf8</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="uuid">cbc4f091-0c51-441b-95b4-6730199b1bf8</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.config"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:ec:54:77"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <target dev="tap666aadbc-06"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/console.log" append="off"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Preparing to wait for external event network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1861734872',display_name='tempest-TestEncryptedCinderVolumes-server-1861734872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1861734872',id=33,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61tIYnzWeAHCeCx1WZ80Q2BjiKlbZwqrxx/d0zmGuS8dLCJwgQ8tehMkF0/URT6wsdynNZRc4rVqNJty5b2TRC+FcE4Peis5BPKJDEJjuk06j4J1giME4HhyvlL9Aluw==',key_name='tempest-keypair-1815078964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-8yoaw3ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=cbc4f091-0c51-441b-95b4-6730199b1bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:43.323704 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:43.326101 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:43.326101 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:43.326101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.326101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:43.326101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:43.326285 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.328231 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d8945f-7776-5b08-a74c-ac73395179c5', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:43.330199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.332331 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:43.335949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.336219 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap666aadbc-06, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:43.336856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap666aadbc-06, col_values=(('qos', UUID('6cec65dc-674a-481b-9d1d-1474d6d0199c')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:43.337099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap666aadbc-06, col_values=(('external_ids', {'iface-id': '666aadbc-06be-4326-beab-7ac3be314c7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:54:77', 'vm-uuid': 'cbc4f091-0c51-441b-95b4-6730199b1bf8'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:43.340404 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.342619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:43.345690 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:43.347559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:43.349037 np0000003683 nova-compute[98991]: INFO os_vif [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06')
Jun 26 02:45:43.405498 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Rescuing
Jun 26 02:45:43.408027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:43.408027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:43.408594 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:43.490202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:43.490912 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-f55cc07d-ec85-458d-a717-ae68d3c27ab8. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:43.491107 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:43.502114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-691b7bd9-66fc-4784-b85c-7c9d2af5cf0f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.474s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:43.550833 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:43.552266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:43.655896 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:43.820202 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updated VIF entry in instance network info cache for port 666aadbc-06be-4326-beab-7ac3be314c7e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:45:43.820532 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updating instance_info_cache with network_info: [{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:43.900624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:43.900909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:43.901169 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:43.901350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:43.901539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:43.904132 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Terminating instance
Jun 26 02:45:43.913577 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:44.055383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c86b8bc7-c537-49cb-8eb3-16c5f219c849 req-bd5dcb38-8056-454d-8bfb-157ad49152e1 service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:44.056827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:44.057117 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port 92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:44.105498 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005326289999629807 future=<Future at 0x72e2ad2f9880 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.105995 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.106284 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Emitting event <LifecycleEvent: 1782441929.1048434, 4ee2c5e4-b366-4693-9031-41425bac0cab => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:44.106445 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.7810549379998974 future=<Future at 0x72e27c4a9040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.106615 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] VM Stopped (Lifecycle Event)
Jun 26 02:45:44.107919 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.7796119330000693 future=<Future at 0x72e27c4a9040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.223548 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:44.322298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2b6131ef-d2a8-4cbe-a983-f545c783f4c1 req-404ff17f-0cb9-4bed-9d17-174adf5ab5ea service nova] Releasing lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:44.357804 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Updating instance_info_cache with network_info: [{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:44.410529 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:44.443927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:44.473453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:44.562289 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:44.609592 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3ad6e783-535b-41bb-a7e4-0714b49fa09f tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 4ee2c5e4-b366-4693-9031-41425bac0cab] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:44.615999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:44.628704 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:44.636061 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:44.636326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:44.636588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:44.636781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:44.636921 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:44.637754 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a68d4977-4b0a-4361-afe8-7aaa4e8f9d13 req-77c5d001-b980-4979-a716-f7e2c5b38484 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:44.669230 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:44.745703 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999675727000067 future=<Future at 0x72e29c2898b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.747658 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Instance destroyed successfully.
Jun 26 02:45:44.748718 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid 8c307448-2d6a-4df3-b427-af9db2c9378a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:44.856930 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:44.860009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-266d20a5-b882-4896-9d47-a60855b80312" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:44.870424 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:44.870587 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:44.870706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:ec:54:77, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:44.871068 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Using config drive
Jun 26 02:45:44.887838 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00029721500004598056 future=<Future at 0x72e27c4a9040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.888202 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Emitting event <LifecycleEvent: 1782441929.887431, 64f180a3-7b25-4094-bcd8-ee5c84773a01 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:44.888368 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.888579 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] VM Stopped (Lifecycle Event)
Jun 26 02:45:44.889446 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.395919918000118 future=<Future at 0x72e27c4b9f10 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:44.889575 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.395759159000136 future=<Future at 0x72e27c4b9f10 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:45.029025 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:45.029266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:45.255622 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-911558535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-911558535',id=20,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:44:07Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-4q026pea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:44:15Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=8c307448-2d6a-4df3-b427-af9db2c9378a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:45.256121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "address": "fa:16:3e:8a:e1:81", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911b3e19-9e", "ovs_interfaceid": "911b3e19-9e80-4d7e-8456-b91f56dc972b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:45.256293 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:45.256562 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:45.259068 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.259068 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap911b3e19-9e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:45.271718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.271718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:45.277340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.278670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.278670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fc067eb-b772-4fd7-bab3-7868c36fb301) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:45.279561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.279561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:45.284644 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:45.286787 np0000003683 nova-compute[98991]: INFO os_vif [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:e1:81,bridge_name='br-int',has_traffic_filtering=True,id=911b3e19-9e80-4d7e-8456-b91f56dc972b,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911b3e19-9e')
Jun 26 02:45:45.288093 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:45:45.288640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:45.288839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:45.289313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:45.289800 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:45:45.289958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:45:45.311981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:45.311981 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:45.311981 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:45.312207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:45.312207 np0000003683 nova-compute[98991]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash)
Jun 26 02:45:45.312207 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:45.312407 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:45:45.312600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:45.313952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:45:45.315051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c2defc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:45:45.315385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:45:45.315724 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Flush multipath device 3300000008f50d4e3 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:45:45.358744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2ed43417-411a-4ad0-8c98-3cdb4655877e req-7a15d5cd-b10e-48ba-b855-fe13fca3721b service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:45.359587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:45.359746 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:45.361138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:45.376485 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:45.390732 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 64f180a3-7b25-4094-bcd8-ee5c84773a01] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:45.413082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:45:45.468758 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:45:45.468963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:45:45.469905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:45:45.482175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:45:45.482266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:45:45.493650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.505427 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Creating config drive at /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.config
Jun 26 02:45:45.509957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrcyw6ti {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:45.530792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.40.100,3260]
Jun 26 02:45:45.530792 np0000003683 nova-compute[98991]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:45.530792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.532633 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:45:45.545398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.558717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.562775 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbrcyw6ti" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:45.606366 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.50.100,3260]
Jun 26 02:45:45.606366 np0000003683 nova-compute[98991]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:45.606366 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.622182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:45.622579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:45.622726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] <== disconnect_volume: return (334ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:45.622859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:45:45.623268 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Deleting instance files /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a_del
Jun 26 02:45:45.623876 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Deletion of /opt/stack/data/nova/instances/8c307448-2d6a-4df3-b427-af9db2c9378a_del complete
Jun 26 02:45:45.862390 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:45.930638 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:46.022874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.059922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.112261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:46.112484 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:46.116279 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:45:46.116603 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Claim successful on node np0000003683
Jun 26 02:45:46.137096 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:46.148167 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.153997 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Took 1.74 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:46.158434 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:46.158434 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:46.158434 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:46.158434 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:46.276024 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3f628da4-6ca5-4e7f-9adb-598737f7b24c req-30648baa-53cf-4391-86f6-ec404ac95158 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:46.276428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3f628da4-6ca5-4e7f-9adb-598737f7b24c req-30648baa-53cf-4391-86f6-ec404ac95158 service nova] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:46.276428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3f628da4-6ca5-4e7f-9adb-598737f7b24c req-30648baa-53cf-4391-86f6-ec404ac95158 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:46.276532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3f628da4-6ca5-4e7f-9adb-598737f7b24c req-30648baa-53cf-4391-86f6-ec404ac95158 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:46.276640 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3f628da4-6ca5-4e7f-9adb-598737f7b24c req-30648baa-53cf-4391-86f6-ec404ac95158 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Processing event network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:46.301901 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:46.344640 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:46.345181 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:45:46.415550 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.418113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.419908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.420956 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.446098 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.503942 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.510631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.530241 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.648058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83b7b3aa-7f1b-4da2-88af-36c7be07b711 req-2ee79397-c075-4502-b434-5456c7d18792 service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:46.648778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:46.649183 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:46.670625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.676451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.694419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.715701 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:46.719728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] Acquiring lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:46.724128 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:46.725047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:46.725047 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] No waiting events found dispatching network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:46.725047 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d694226a-acd8-482e-9e4d-87b5efdf104c req-136a4915-d5db-4731-b587-4e394caba6d1 service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-unplugged-911b3e19-9e80-4d7e-8456-b91f56dc972b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] No waiting events found dispatching network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:46.764770 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-39bea754-c3fd-4a12-baf0-f6886e8e1681 req-d573ff3e-46a7-4500-85b7-dcca0f47b0f2 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received unexpected event network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 for instance with vm_state active and task_state rescuing.
Jun 26 02:45:46.783202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.790722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:46.817806 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999605445999805 future=<Future at 0x72e29c5dbdd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:46.819817 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance destroyed successfully.
Jun 26 02:45:46.820315 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'numa_topology' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:46.923091 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:46.923597 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441946.9231298, cbc4f091-0c51-441b-95b4-6730199b1bf8 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:46.923785 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] VM Started (Lifecycle Event)
Jun 26 02:45:46.925228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:46.931411 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Instance spawned successfully.
Jun 26 02:45:46.931810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:47.195046 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:47.252962 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:47.329907 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Attempting rescue
Jun 26 02:45:47.330676 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:45:47.341877 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:45:47.342040 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Creating image(s)
Jun 26 02:45:47.345557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:47.345557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:47.345557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:47.345557 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'trusted_certs' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:47.345557 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:47.427171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:47.435791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:47.439069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.439240 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.439651 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.439969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.440307 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.440666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:47.477913 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:47.682650 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:47.682848 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:47.697009 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Took 1.54 seconds to deallocate network for instance.
Jun 26 02:45:47.796262 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:47.845870 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:47.846672 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:47.853858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:47.855397 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:47.857973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:47.858280 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:47.859166 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:47.863131 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:47.865041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:47.938603 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:47.938994 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441947.9387844, cbc4f091-0c51-441b-95b4-6730199b1bf8 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:47.939130 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] VM Paused (Lifecycle Event)
Jun 26 02:45:47.949641 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Took 6.34 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:47.949798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:47.955646 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:47.958375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:48.012817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue" returned: 0 in 0.054s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:48.013305 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:48.013691 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'migration_context' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:48.141929 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:48.186356 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:48.249559 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:45:48.251687 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Deleting volume: 5ce3e522-86e4-4a24-816c-59b9f9db1e9a {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:45:48.349632 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:48.350031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:48.350031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:48.350466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:48.350466 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] No waiting events found dispatching network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:48.350466 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-041f87e2-198d-4788-ac63-d02f798da418 req-648cde69-080d-4a71-b8a0-9633c73bbe62 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received unexpected event network-vif-plugged-666aadbc-06be-4326-beab-7ac3be314c7e for instance with vm_state active and task_state None.
Jun 26 02:45:48.444305 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:48.451758 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441948.451357, cbc4f091-0c51-441b-95b4-6730199b1bf8 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:48.452076 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] VM Resumed (Lifecycle Event)
Jun 26 02:45:48.459572 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Took 14.02 seconds to build instance.
Jun 26 02:45:48.505037 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:48.516115 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:48.516389 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:48.516876 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start _get_guest_xml network_info=[{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:de:90:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:48.517019 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:48.693454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.581s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:48.694279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.840s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:48.694692 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:45:48.696780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:48.696973 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:45:48.794646 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:48.798013 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:48.798187 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:48.846715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Received event network-vif-deleted-911b3e19-9e80-4d7e-8456-b91f56dc972b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:48.846805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:48.846979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:48.847120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:48.847247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:48.847354 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] No waiting events found dispatching network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:48.847516 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a37e81b0-edd2-4aa1-ad27-c4d7ba1c041a req-b39aaa46-7f46-4867-9bb4-b5281c9e65bb service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received unexpected event network-vif-unplugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 for instance with vm_state active and task_state rescuing.
Jun 26 02:45:48.956117 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:48.957581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:48.960898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.524s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:49.018873 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:49.021162 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:49.022849 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1997991914', uuid='266d20a5-b882-4896-9d47-a60855b80312'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:de:90:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441949.0223677) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:49.024053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:49.024484 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:49.025361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:49.025607 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:49.026713 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:49.027129 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:49.027325 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:49.027460 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:49.027668 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:49.027802 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:49.027933 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:49.028125 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:49.028267 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:49.028417 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:49.028636 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:49.028802 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:49.029003 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'vcpu_model' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:49.176770 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:49.202733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:45:49.202983 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:45:49.203208 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:49.203472 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:49.309612 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a90f9b496904250a9167c7761ad6f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac7218fd5ea43579f052f1bd83fe39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:45:49.455518 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:49.455950 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:49.515380 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:49.533508 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:49.542085 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1997991914',display_name='tempest-ServerRescueNegativeTestJSON-server-1997991914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1997991914',id=31,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:42Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-45b7r4od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:43Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=266d20a5-b882-4896-9d47-a60855b80312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:de:90:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:49.542565 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:de:90:2e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:49.543264 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:49.544082 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:49.654305 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [{"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:49.712019 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:45:49.728288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:49.767741 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Successfully created port: 92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:45:49.819004 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:49.820540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:49.906842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:49.911231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:49.959173 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:49.996650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:49.997247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.047064 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <uuid>266d20a5-b882-4896-9d47-a60855b80312</uuid>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <name>instance-0000001f</name>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1997991914</nova:name>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:49</nova:creationTime>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         <nova:port uuid="56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="serial">266d20a5-b882-4896-9d47-a60855b80312</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="uuid">266d20a5-b882-4896-9d47-a60855b80312</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config.rescue"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:de:90:2e"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <target dev="tap56b20aa7-5a"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/console.log" append="off"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:50.049324 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:50.057600 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance destroyed successfully.
Jun 26 02:45:50.089001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.094390 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.158046 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:50.159592 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance network_info: |[{"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:50.161245 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Start _get_guest_xml network_info=[{"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5a0ef5ca-0839-4d80-b87c-39516402ce0f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '00f46ba2-9383-40fb-af68-61fe8d692c6d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'serial': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '4882f643-ff54-474b-8458-aaab51e41f25', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '00f46ba2-9383-40fb-af68-61fe8d692c6d', 'attached_at': '', 'detached_at': '', 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'serial': '375eb09e-23f6-4946-983f-f6c7ca89d076'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'volume_type': None}, {'attachment_id': '5088add7-9f4b-4abe-b4ea-d08b6d7c89fc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '00f46ba2-9383-40fb-af68-61fe8d692c6d', 'attached_at': '', 'detached_at': '', 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'serial': '0ec19119-f855-41bf-a3dc-452f25bc62c7'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:50.164620 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:50.166361 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1258360344', uuid='00f46ba2-9383-40fb-af68-61fe8d692c6d'), owner=OwnerMeta(userid='7ba91ef3eaa94fcf8f4627a6d0d37c10', username='tempest-TaggedBootDevicesTest_v242-285870187-project-member', projectid='09e8df8f519e47eeba096968739cfd68', projectname='tempest-TaggedBootDevicesTest_v242-285870187'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441950.1658556) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:50.167915 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:50.168311 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:50.169406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:50.169603 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:50.171078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:50.171608 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:50.171749 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:50.171857 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:50.171984 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:50.172098 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:50.172203 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:50.172369 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:50.172912 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:50.173055 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:50.173175 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:50.173293 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:50.184697 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:50.185041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:50.185190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:50.185628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:50.186440 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:50.194587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.195017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.211152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:50.214517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:50.215682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:50.216220 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:50.218537 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:45:50.226242 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.012s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:50.226499 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:50.234899 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:50.234899 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:50.241036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:50.241036 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c] added
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:50.251810 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c] added
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:50.254985 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:50.255269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:50.255459 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:50.255682 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:50.280390 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:50.289616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.292860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.317640 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Successfully updated port: 92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:45:50.377304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.377977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.405733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-changed-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:50.405848 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Refreshing instance network info cache due to event network-changed-92fe4ccc-62d5-475f-b0f5-74afdb1321fe. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:50.406439 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] Acquiring lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:50.406573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] Acquired lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:50.406885 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Refreshing network info cache for port 92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:50.462648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.463265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.483884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.685s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:50.545026 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Deleted allocations for instance 8c307448-2d6a-4df3-b427-af9db2c9378a
Jun 26 02:45:50.553120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.553522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.635918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.636451 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000001f, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config.rescue'
Jun 26 02:45:50.641639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.739069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.739744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.822826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:50.822826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.829659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.904528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-changed-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:50.904743 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Refreshing instance network info cache due to event network-changed-666aadbc-06be-4326-beab-7ac3be314c7e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:45:50.904964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] Acquiring lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:50.905058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] Acquired lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:50.905206 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Refreshing network info cache for port 666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:45:50.910175 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:50.917131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:50.917748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:50.998699 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:51.003532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.006858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.094931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.095368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.168260 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:51.179263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.182033 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:51.183008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.220930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.038s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.221287 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50334MB free_disk=73.76133346557617GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:45:51.221638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.221751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.241383 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:45:51.249070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.249070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.249070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.249070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.249070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:51.249995 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Terminating instance
Jun 26 02:45:51.251470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:45:51.251786 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Creating image(s)
Jun 26 02:45:51.252605 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:51.254153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.254393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.255210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:51.257889 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:51.262015 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:51.263021 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:51.265099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:51.280830 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:51.288943 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.296616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.301691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.308413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:45:51.308413 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:51.309662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:45:51.309662 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:51.309662 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:45:51.309662 np0000003683 nova-compute[98991]: 
Jun 26 02:45:51.314896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:45:51.314896 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:51.315113 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:45:51.315113 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:51.315276 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:45:51.315276 np0000003683 nova-compute[98991]: 
Jun 26 02:45:51.339403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.40.100,3260]
Jun 26 02:45:51.339403 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:51.339403 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.353822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.362905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.50.100,3260]
Jun 26 02:45:51.362905 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:51.362905 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.369033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.369723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.371063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.371063 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.371063 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:51.371557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.372652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.372652 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.372652 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:51.372652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:51.372652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:51.373517 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:51.374235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:51.379314 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:45:51.380056 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.399705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.399705 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.399705 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:51.400011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.400011 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:51.400011 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:51.401017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:51.401278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:51.401961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('7', '-', '-', 0) found on session 58 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:51.402309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:51.403384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('8', '-', '-', 0) found on session 59 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:51.403627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:51.409092 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:51.431907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 58 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:51.431907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:51.433113 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 59 and hctl ['8', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:51.482332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.482895 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.545219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk 1073741824" returned: 0 in 0.062s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.546102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:51.546102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.566968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2e4e01e0-9a72-4b88-83be-454c9987e7e9 tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "8c307448-2d6a-4df3-b427-af9db2c9378a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.666s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:51.589155 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:51.589155 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:51.589155 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:51.589155 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:de:90:2e, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:51.590252 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Using config drive
Jun 26 02:45:51.642348 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.642853 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:45:51.643217 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:51.674259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ed0e6e2c-dcc6-4057-be0f-183b6e6d1cf1 req-c93c9cbf-1843-461b-9309-70a524161e4f service nova] Releasing lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:51.676657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquired lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:51.677259 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:51.694297 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.735379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:51.736238 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Cannot resize image /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:45:51.738469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:45:51.738678 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Ensure instance console log exists: /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:45:51.739230 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:51.739485 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:51.739632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:51.764679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:51.794436 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.797108 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:51.801758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.815712 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.819422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.841628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.851288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:51.951764 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updated VIF entry in instance network info cache for port 666aadbc-06be-4326-beab-7ac3be314c7e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:45:51.952020 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updating instance_info_cache with network_info: [{"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:52.095825 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'ec2_ids' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:52.112119 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999691036000058 future=<Future at 0x72e29c2080e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:52.113291 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Instance destroyed successfully.
Jun 26 02:45:52.114293 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'resources' on Instance uuid ed3b38c4-c012-4f44-8801-8bc21e30c0c5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:52.285891 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004937520000112272 future=<Future at 0x72e27c4b9f10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:52.287401 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:52.287910 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.45735704599997 future=<Future at 0x72e29c2898b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:52.288072 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.456884006000109 future=<Future at 0x72e29c2898b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:52.288394 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Emitting event <LifecycleEvent: 1782441937.2852635, 716bc480-bbf9-4921-8f5e-d382bf7100ed => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:52.288656 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] VM Stopped (Lifecycle Event)
Jun 26 02:45:52.293053 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293053 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance cb30fcf0-34d3-4008-b128-9bd46080c204 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293053 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293230 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293230 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 121ec5e6-08cf-4e0c-9c89-e2be23a274be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293334 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 266d20a5-b882-4896-9d47-a60855b80312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293462 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 00f46ba2-9383-40fb-af68-61fe8d692c6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293649 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance cbc4f091-0c51-441b-95b4-6730199b1bf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293773 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a39d0d03-58af-46e4-b549-78cf284446c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:45:52.293940 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:45:52.294099 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:45:51 up 32 min,  2 users,  load average: 6.74, 5.80, 3.12\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_deleting': '1', 'num_os_type_None': '9', 'num_proj_f149d284f0d24070afe71cccd4c0c744': '1', 'io_workload': '3', 'num_task_None': '5', 'num_proj_5bb8ac3d99734c44bd220c90726dd72d': '1', 'num_proj_8a7eadbb081143fb8f96d0187a0f7c09': '1', 'num_proj_a94375dca8764ff8b335b461730d4cdb': '1', 'num_proj_d2b07c33d4ed466ca32fa63a7e8b74e4': '2', 'num_task_rescuing': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_09e8df8f519e47eeba096968739cfd68': '1', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_proj_bac7218fd5ea43579f052f1bd83fe39b': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:45:52.434521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 59 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:52.434521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:52.453803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-25d94cbe-8044-4021-892c-c7c12b886ce3 req-3c86e12a-75ac-4e6c-a8c4-961cfb064e06 service nova] Releasing lock "refresh_cache-cbc4f091-0c51-441b-95b4-6730199b1bf8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:52.472582 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:45:52.489334 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:52.489911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:52.489911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:52.489911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:52.490151 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:52.490151 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-984541b7-c5dd-4bf6-aadc-be538a984026 req-f4ef2371-a9e9-4276-b2e3-fb079835c5e7 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:52.599665 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:52.599884 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'keypairs' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:52.617756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-54203554',display_name='tempest-AttachVolumeTestJSON-server-54203554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-54203554',id=17,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdLf0/JAeDpJLztRSbpCO5RTG8EIbca2WKVfZN+P7PtkLP7Zxa/AknsPcSZRt2KvSZa+f2Z3I+bojIVp5P9MaecGjAdzxN467BTtcOE31+i1uy70XdWW2T8h9tuU6P0kg==',key_name='tempest-keypair-1564501763',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-x85pn1hf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=ed3b38c4-c012-4f44-8801-8bc21e30c0c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:52.620295 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "address": "fa:16:3e:39:e3:37", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a37bc6-1d", "ovs_interfaceid": "a0a37bc6-1dae-4326-bcc9-fae26e81828a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:52.621594 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:52.621968 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:52.626060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.626060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a37bc6-1d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:52.627172 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.628095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:52.632762 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.634467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.634801 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40f8d581-673e-45b0-a861-2b039e3ece6c) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:52.635943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.636666 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:52.642196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:52.644820 np0000003683 nova-compute[98991]: INFO os_vif [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e3:37,bridge_name='br-int',has_traffic_filtering=True,id=a0a37bc6-1dae-4326-bcc9-fae26e81828a,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a37bc6-1d')
Jun 26 02:45:52.645180 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Deleting instance files /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5_del
Jun 26 02:45:52.646025 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Deletion of /opt/stack/data/nova/instances/ed3b38c4-c012-4f44-8801-8bc21e30c0c5_del complete
Jun 26 02:45:52.714972 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:52.740515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:52.740515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:52.740515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:52.740515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:52.740515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:52.742364 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Terminating instance
Jun 26 02:45:52.794044 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: 716bc480-bbf9-4921-8f5e-d382bf7100ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:52.894835 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updating instance_info_cache with network_info: [{"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:52.926397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:52.926740 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:53.102597 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<266d20a5-b882-4896-9d47-a60855b80312> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:45:53.105222 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:53.152239 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:53.152797 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:53.153141 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:53.153263 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:53.153501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:53.226971 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:53.235453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Found WWN 330000000eb7b691d for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:45:53.235453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:53.235453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000eb7b691d', 'path': '/dev/dm-0', 'multipath_id': '330000000eb7b691d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:53.235453 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eb7b691d', 'path': '/dev/dm-0', 'multipath_id': '330000000eb7b691d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:45:53.246692 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:45:53.254757 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Creating config drive at /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config.rescue
Jun 26 02:45:53.259644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfbdqd8_1 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:53.282322 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.285880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.313229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.329395 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.337770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfbdqd8_1" returned: 0 in 0.077s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:53.366002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.398562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Releasing lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:53.399129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance network_info: |[{"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:45:53.401962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Start _get_guest_xml network_info=[{"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:45:53.404764 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:45:53.406717 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1099058061', uuid='a39d0d03-58af-46e4-b549-78cf284446c0'), owner=OwnerMeta(userid='6a90f9b496904250a9167c7761ad6f7b', username='tempest-VolumesSnapshotTestJSON-670786988-project-member', projectid='bac7218fd5ea43579f052f1bd83fe39b', projectname='tempest-VolumesSnapshotTestJSON-670786988'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441953.4061882) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:45:53.407842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:45:53.408316 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:45:53.409444 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:45:53.409767 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:45:53.410891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:45:53.411226 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:45:53.411383 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:45:53.411545 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:45:53.411700 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:45:53.411788 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:45:53.411906 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:45:53.412161 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:45:53.412331 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:45:53.412504 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:45:53.413048 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:45:53.413048 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:45:53.424248 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1099058061',display_name='tempest-VolumesSnapshotTestJSON-instance-1099058061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1099058061',id=34,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkuKPz2JhFRBFZqwidObB/jupuUT1tBeKYpGMVqCC7WHru7TQSPXthuPmO2yBnhiapOgc2VY4UHKdkWrV2kpY7hnavbL7YTa+n2PqpxCxRf2phNxkrhB04yC7y4W+MFog==',key_name='tempest-keypair-1320854438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-953osuu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=a39d0d03-58af-46e4-b549-78cf284446c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:45:53.424564 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:53.425307 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:53.426256 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'pci_devices' on Instance uuid a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:53.431946 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:53.481386 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:53.481723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:53.484992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:53.485187 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:53.485380 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] No waiting events found dispatching network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:53.485578 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f18f7773-a966-4f71-a1fc-ee8858b283db req-bcbac6dc-fa42-44af-b2be-874e260fe44b service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:53.549268 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.566242 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.681021 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999705260999917 future=<Future at 0x72e27c2c7350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:53.681229 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Instance destroyed successfully.
Jun 26 02:45:53.682222 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lazy-loading 'resources' on Instance uuid cb30fcf0-34d3-4008-b128-9bd46080c204 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:45:53.740813 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:53.741312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:53.741509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:53.742979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:53.743230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:53.755034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:53.756668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:53.757199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:53.757431 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:53.757915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:53.758124 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:53.768786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:53.768786 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:53.772094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:53.772094 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076] added
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:53.781873 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:53.782079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:53.782212 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:53.782380 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076] added
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:53.786867 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:53.787445 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:53.787445 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:53.787445 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:53.929248 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <uuid>a39d0d03-58af-46e4-b549-78cf284446c0</uuid>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <name>instance-00000022</name>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1099058061</nova:name>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:53</nova:creationTime>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:user uuid="6a90f9b496904250a9167c7761ad6f7b">tempest-VolumesSnapshotTestJSON-670786988-project-member</nova:user>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:project uuid="bac7218fd5ea43579f052f1bd83fe39b">tempest-VolumesSnapshotTestJSON-670786988</nova:project>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         <nova:port uuid="92fe4ccc-62d5-475f-b0f5-74afdb1321fe">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="serial">a39d0d03-58af-46e4-b549-78cf284446c0</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="uuid">a39d0d03-58af-46e4-b549-78cf284446c0</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.config"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e7:d4:96"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <target dev="tap92fe4ccc-62"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/console.log" append="off"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:45:53.930469 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Preparing to wait for external event network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1099058061',display_name='tempest-VolumesSnapshotTestJSON-instance-1099058061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1099058061',id=34,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkuKPz2JhFRBFZqwidObB/jupuUT1tBeKYpGMVqCC7WHru7TQSPXthuPmO2yBnhiapOgc2VY4UHKdkWrV2kpY7hnavbL7YTa+n2PqpxCxRf2phNxkrhB04yC7y4W+MFog==',key_name='tempest-keypair-1320854438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-953osuu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=a39d0d03-58af-46e4-b549-78cf284446c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:53.932748 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:45:53.936761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.936761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:53.936761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:45:53.937237 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.937237 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62e0da14-dacf-577a-a010-61a546808b46', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:53.940620 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:45:53.940620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.718s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:53.940620 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:53.940620 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:45:53.962190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.967994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.971944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.972164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92fe4ccc-62, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:53.972609 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92fe4ccc-62, col_values=(('qos', UUID('fdb4efb0-3871-4f65-a757-a839257f5155')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:53.972822 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92fe4ccc-62, col_values=(('external_ids', {'iface-id': '92fe4ccc-62d5-475f-b0f5-74afdb1321fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d4:96', 'vm-uuid': 'a39d0d03-58af-46e4-b549-78cf284446c0'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:53.975559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.978945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:53.984406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:53.986600 np0000003683 nova-compute[98991]: INFO os_vif [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62')
Jun 26 02:45:54.085673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.092006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.112513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.185798 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167003128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverbootfromvolumestablerescuetest-server-167003128',id=18,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:43:13Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb8ac3d99734c44bd220c90726dd72d',ramdisk_id='',reservation_id='r-aa4v31o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:43:21Z,user_data=None,user_id='549e56d3a63947e894b5d6d92dd4eafa',uuid=cb30fcf0-34d3-4008-b128-9bd46080c204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:45:54.185798 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converting VIF {"id": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "address": "fa:16:3e:8f:93:41", "network": {"id": "af86d6ec-ce87-41cc-83bf-633ff798a193", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1708742722-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bb8ac3d99734c44bd220c90726dd72d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap053c7324-46", "ovs_interfaceid": "053c7324-4690-4a7c-9a7d-4b70a82e2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:45:54.185798 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:45:54.185798 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:45:54.186892 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.187139 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap053c7324-46, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:54.188262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.189061 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:54.195759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.196839 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.196909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01cf6dbe-2f19-47d2-bec2-810c06dab28a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:45:54.197509 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.198213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:45:54.203875 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:54.208514 np0000003683 nova-compute[98991]: INFO os_vif [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:93:41,bridge_name='br-int',has_traffic_filtering=True,id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1,network=Network(af86d6ec-ce87-41cc-83bf-633ff798a193),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053c7324-46')
Jun 26 02:45:54.208514 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Deleting instance files /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204_del
Jun 26 02:45:54.208514 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Deletion of /opt/stack/data/nova/instances/cb30fcf0-34d3-4008-b128-9bd46080c204_del complete
Jun 26 02:45:54.224994 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:54.569268 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:54.569751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] Acquiring lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:54.569927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:54.570074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:54.570236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] No waiting events found dispatching network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:54.570414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-unplugged-a0a37bc6-1dae-4326-bcc9-fae26e81828a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:54.570577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65b5b1df-fca8-4101-8b10-1c399a4c2cdd req-edf3e803-6539-4a89-9f3f-74154ca9b391 service nova] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Received event network-vif-deleted-a0a37bc6-1dae-4326-bcc9-fae26e81828a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:54.714434 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Took 1.47 seconds to destroy the instance on the hypervisor.
Jun 26 02:45:54.715256 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:45:54.715617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:45:54.715726 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:45:54.716079 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:54.727079 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Took 1.57 seconds to deallocate network for instance.
Jun 26 02:45:54.759449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 266d20a5-b882-4896-9d47-a60855b80312 due to new event <LifecycleEvent: 1782441954.759109, 266d20a5-b882-4896-9d47-a60855b80312 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:45:54.759651 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441954.759109, 266d20a5-b882-4896-9d47-a60855b80312 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:54.759791 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Resumed (Lifecycle Event)
Jun 26 02:45:54.762660 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cbd4af4-ddb0-4bdb-9513-edab5c3ce4be tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:54.782883 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:54.787822 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:54.798936 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:54.804205 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.813264 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.822618 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.827911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.827911 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.827911 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:54.828093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.828093 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.828093 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:54.838043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.838043 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.838043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:54.838181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.838181 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.838181 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:54.847893 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:54.866890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.40.100,3260]
Jun 26 02:45:54.866890 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:54.866890 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.884035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.893043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.50.100,3260]
Jun 26 02:45:54.893043 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:54.893043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.899781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.899781 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.899781 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.899781 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.899781 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:54.899970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.899970 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.899970 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.899970 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.899970 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:54.900167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:54.900290 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:54.900954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('9', '-', '-', 0) found on session 60 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:54.901084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:54.908155 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:54.921639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 60 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:54.921639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:54.925433 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:54.925675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:54.925819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:54.926471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('10', '-', '-', 0) found on session 61 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:54.927618 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:54.948680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 61 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:54.949028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:55.233909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:55.234057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:55.265614 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:55.267457 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:55.506423 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:55.506595 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:45:55.506714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No VIF found with MAC fa:16:3e:e7:d4:96, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:45:55.507570 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Using config drive
Jun 26 02:45:55.561025 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:55.561276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Acquiring lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:55.561438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:55.561633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:55.562035 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] No waiting events found dispatching network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:55.562206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-unplugged-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:45:55.562366 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:55.562616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:55.562774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:55.562902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:55.563033 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] No waiting events found dispatching network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:55.563187 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received unexpected event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 for instance with vm_state rescued and task_state None.
Jun 26 02:45:55.563317 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:55.563513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:55.563659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:55.563811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:55.563948 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] No waiting events found dispatching network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:55.564099 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received unexpected event network-vif-plugged-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 for instance with vm_state rescued and task_state None.
Jun 26 02:45:55.564246 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Received event network-vif-deleted-053c7324-4690-4a7c-9a7d-4b70a82e2ee1 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:55.564401 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Neutron deleted interface 053c7324-4690-4a7c-9a7d-4b70a82e2ee1; detaching it from the instance and deleting it from the info cache
Jun 26 02:45:55.565805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d7354b-de7e-4e13-b568-0fe18bcb98ec req-41b47fe6-80f9-4b4e-bafd-b6f8506684fa service nova] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Detach interface failed, port_id=053c7324-4690-4a7c-9a7d-4b70a82e2ee1, reason: Instance cb30fcf0-34d3-4008-b128-9bd46080c204 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:45:55.608660 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:55.700791 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:55.703151 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:55.757953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:45:55.772181 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441955.7719033, 266d20a5-b882-4896-9d47-a60855b80312 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:55.772339 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Started (Lifecycle Event)
Jun 26 02:45:55.935489 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.935837 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936036 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936278 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936494 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936698 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936875 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:45:55.936981 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:45:55.937224 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.41 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:45:56.012894 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:56.108835 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Took 1.39 seconds to deallocate network for instance.
Jun 26 02:45:56.146330 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Creating config drive at /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.config
Jun 26 02:45:56.156371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfmvlqyro {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:45:56.205449 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:56.212643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfmvlqyro" returned: 0 in 0.057s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:45:56.274894 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:56.277434 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:56.614697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:56.628104 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:56.663833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:56.698388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:56.715540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.481s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:56.718166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.101s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:56.739562 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:56.777902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Found WWN 330000000f72e0a58 for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:45:56.778346 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:56.778701 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000f72e0a58', 'path': '/dev/dm-3', 'multipath_id': '330000000f72e0a58'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:45:56.778870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f72e0a58', 'path': '/dev/dm-3', 'multipath_id': '330000000f72e0a58'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:45:56.795075 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Deleted allocations for instance ed3b38c4-c012-4f44-8801-8bc21e30c0c5
Jun 26 02:45:56.877202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-32efe2d6-18fa-4e0f-962e-d945031aea78 req-035d436f-b998-40a9-8c6a-e9be732acfcc service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:56.877202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32efe2d6-18fa-4e0f-962e-d945031aea78 req-035d436f-b998-40a9-8c6a-e9be732acfcc service nova] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:56.877563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32efe2d6-18fa-4e0f-962e-d945031aea78 req-035d436f-b998-40a9-8c6a-e9be732acfcc service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:56.877563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32efe2d6-18fa-4e0f-962e-d945031aea78 req-035d436f-b998-40a9-8c6a-e9be732acfcc service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:56.878597 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-32efe2d6-18fa-4e0f-962e-d945031aea78 req-035d436f-b998-40a9-8c6a-e9be732acfcc service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Processing event network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:45:57.004053 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:57.007788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:57.014800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:57.044254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:57.235712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:45:57.236025 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:45:57.298795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:45:57.301310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:45:57.301523 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:57.302071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:57.302357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:45:57.316211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:57.316688 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:57.316914 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:57.317356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:45:57.317929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:45:57.318106 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:57.331292 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:57.331292 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:57.342836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:45:57.342836 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7] added
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:57.344392 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:57.344797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:57.345043 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:57.345273 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7] added
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:45:57.357124 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:57.357531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:45:57.357531 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:45:57.357626 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:45:57.502232 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441957.5019057, a39d0d03-58af-46e4-b549-78cf284446c0 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:57.502744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:45:57.503047 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] VM Started (Lifecycle Event)
Jun 26 02:45:57.505260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:45:57.508264 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance spawned successfully.
Jun 26 02:45:57.508607 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:45:57.584927 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Rescuing
Jun 26 02:45:57.585119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:45:57.585235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:45:57.585388 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:45:57.739242 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:45:57.804503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-df695547-44ea-43b7-9ccf-3db53c2bff59 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "ed3b38c4-c012-4f44-8801-8bc21e30c0c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.557s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:58.008795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:58.010923 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:58.016512 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.016687 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.017068 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.017352 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.017704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.018048 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:45:58.087625 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:58.245900 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.531s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:58.314216 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Deleted allocations for instance cb30fcf0-34d3-4008-b128-9bd46080c204
Jun 26 02:45:58.345824 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:45:58.358060 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:58.363217 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:45:58.377997 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.387242 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.394330 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.408117 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408117 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408117 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408117 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408117 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:58.408624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408624 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408624 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408624 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408624 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:58.408940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408940 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.408940 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408940 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.408940 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:58.409182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.409182 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.409182 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.409182 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.409182 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:58.446107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.40.100,3260]
Jun 26 02:45:58.446107 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.40.100,3260] successful.
Jun 26 02:45:58.446107 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.451029 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:45:58.455139 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.50.100,3260]
Jun 26 02:45:58.455139 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.50.100,3260] successful.
Jun 26 02:45:58.455139 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.461017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.472126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.479113 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.479332 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:58.479566 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:58.479679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:58.480428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('11', '-', '-', 0) found on session 62 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:58.480682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.487720 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:45:58.487852 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:45:58.488029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:45:58.488136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:45:58.488940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] HCTL ('12', '-', '-', 0) found on session 63 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:45:58.489030 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:45:58.502902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 62 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:58.502902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:58.509305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Searching for a device in session 63 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:45:58.509305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:45:58.514732 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:45:58.515841 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441958.515602, a39d0d03-58af-46e4-b549-78cf284446c0 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:58.515977 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] VM Paused (Lifecycle Event)
Jun 26 02:45:58.524521 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Took 7.28 seconds to spawn the instance on the hypervisor.
Jun 26 02:45:58.524726 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:58.606937 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Updating instance_info_cache with network_info: [{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] No waiting events found dispatching network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:45:58.951564 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-2d8ff3ed-948a-4d55-964f-1d6847875b52 req-5359ea62-c30a-44b4-9456-50c358742d84 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received unexpected event network-vif-plugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe for instance with vm_state active and task_state None.
Jun 26 02:45:59.018227 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:59.019884 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441959.019562, a39d0d03-58af-46e4-b549-78cf284446c0 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:59.019995 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] VM Resumed (Lifecycle Event)
Jun 26 02:45:59.035683 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Took 12.99 seconds to build instance.
Jun 26 02:45:59.107103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:45:59.198264 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:45:59.319150 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:45:59.323370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e21385a-7da6-493c-ba76-e160eaef31ca tempest-ServerBootFromVolumeStableRescueTest-1363934813 tempest-ServerBootFromVolumeStableRescueTest-1363934813-project-member] Lock "cb30fcf0-34d3-4008-b128-9bd46080c204" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.584s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:59.522445 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:45:59.529512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:45:59.538038 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d4af48-3298-4302-929d-3d96baf3bce1 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:45:59.745618 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0006376710000495223 future=<Future at 0x72e29c2898b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.745941 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782441944.7448814, 8c307448-2d6a-4df3-b427-af9db2c9378a => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:45:59.746059 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.746211 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] VM Stopped (Lifecycle Event)
Jun 26 02:45:59.747901 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.069732624999915 future=<Future at 0x72e29c5dbdd0 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.747901 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.0696134419999908 future=<Future at 0x72e29c5dbdd0 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.747901 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.747901 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.3638872630001515 future=<Future at 0x72e29c2080e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:45:59.748076 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.363775625000017 future=<Future at 0x72e29c2080e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:00.256848 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 8c307448-2d6a-4df3-b427-af9db2c9378a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:00.343559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Found WWN 330000000ee73d5f9 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:00.343559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:00.343559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000ee73d5f9', 'path': '/dev/dm-4', 'multipath_id': '330000000ee73d5f9'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:00.343559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee73d5f9', 'path': '/dev/dm-4', 'multipath_id': '330000000ee73d5f9'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:00.773421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:00.798807 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:00.852767 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.852767 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.853289 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.854319 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.854517 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.855380 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.858022 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.858297 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.859260 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.859648 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.859818 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.860238 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.860929 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.861141 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.861704 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.862292 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.862461 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.862897 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.863445 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:00.863660 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:00.864129 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:00.865384 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lazy-loading 'pci_devices' on Instance uuid 00f46ba2-9383-40fb-af68-61fe8d692c6d {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:00.874689 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:00.874924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:00.946607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:00.953781 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.043704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-changed-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:01.043889 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Refreshing instance network info cache due to event network-changed-92fe4ccc-62d5-475f-b0f5-74afdb1321fe. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:01.044124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] Acquiring lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:01.044246 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] Acquired lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:01.044358 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Refreshing network info cache for port 92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:01.059838 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:01.060683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.060838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.060984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.061054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:01.061174 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3dd969f3-211b-482f-8441-d288a18f6766 req-985fbb64-1411-47c6-bed5-7818a898bb9f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state active and task_state rescuing.
Jun 26 02:46:01.085812 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999671088000014 future=<Future at 0x72e2b3d9c590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:01.087920 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance destroyed successfully.
Jun 26 02:46:01.088179 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'numa_topology' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:01.169521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <uuid>00f46ba2-9383-40fb-af68-61fe8d692c6d</uuid>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <name>instance-00000020</name>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:name>tempest-device-tagging-server-1258360344</nova:name>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:45:50</nova:creationTime>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:user uuid="7ba91ef3eaa94fcf8f4627a6d0d37c10">tempest-TaggedBootDevicesTest_v242-285870187-project-member</nova:user>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:project uuid="09e8df8f519e47eeba096968739cfd68">tempest-TaggedBootDevicesTest_v242-285870187</nova:project>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="4c428988-ac19-4dba-8540-640346338513">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="a0e40ad4-f92c-40c3-a556-f8e40b33f4ea">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="c7c33687-ea16-4c3a-a1cf-e5ab51039f82">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="58eb4121-75dd-45b6-a7bd-34b53605d00d">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="f55cc07d-ec85-458d-a717-ae68d3c27ab8">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         <nova:port uuid="92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="serial">00f46ba2-9383-40fb-af68-61fe8d692c6d</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="uuid">00f46ba2-9383-40fb-af68-61fe8d692c6d</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/disk.config"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <alias name="ua-b445d202-d2f5-44ff-8efc-5cb55da9ea0c"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <serial>b445d202-d2f5-44ff-8efc-5cb55da9ea0c</serial>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <alias name="ua-375eb09e-23f6-4946-983f-f6c7ca89d076"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-3"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <serial>375eb09e-23f6-4946-983f-f6c7ca89d076</serial>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <alias name="ua-0ec19119-f855-41bf-a3dc-452f25bc62c7"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="vdc" bus="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <serial>0ec19119-f855-41bf-a3dc-452f25bc62c7</serial>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c8:09:c2"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tap4c428988-ac"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:cd:fd:01"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tapa0e40ad4-f9"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:45:7b:ea"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tap4d85a6c9-6d"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:6c:c6:47"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tapc7c33687-ea"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:75:5f:24"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tap58eb4121-75"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:44:31:f9"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tapf55cc07d-ec"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:57:d5:a3"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <target dev="tap92f2b92b-e7"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/console.log" append="off"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:01.373205 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Preparing to wait for external event network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.376618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.377430 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.377430 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.377747 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.377951 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.378283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.378936 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.378936 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.383539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.383539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a13f2359-4052-587a-b8b4-787963c43d8a', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.383539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:01.393316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.396680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.400658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.400658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c428988-ac, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.401138 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c428988-ac, col_values=(('qos', UUID('1c69ff4e-c674-43bf-a8c7-dd7aff0ca364')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.401138 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c428988-ac, col_values=(('external_ids', {'iface-id': '4c428988-ac19-4dba-8540-640346338513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:09:c2', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.405700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.411645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.412130 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac')
Jun 26 02:46:01.412793 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.412959 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.413438 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.413680 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.413920 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.414080 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.414222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.414916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.415054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae692547-907e-59cb-8ce8-f956af35be8c', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.416364 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.416550 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.425440 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.427679 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.427904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e40ad4-f9, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.428196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0e40ad4-f9, col_values=(('qos', UUID('559b6b8b-177d-4cfc-81d4-1017ac457ae2')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.428328 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0e40ad4-f9, col_values=(('external_ids', {'iface-id': 'a0e40ad4-f92c-40c3-a556-f8e40b33f4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:fd:01', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.430759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.446009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.446878 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9')
Jun 26 02:46:01.447767 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.448285 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.448921 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.449212 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.449429 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.449684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.449833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.450637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.450769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c66676a-203e-5037-ba9e-0e357232a330', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.452212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.469322 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.474201 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.474201 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d85a6c9-6d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.474959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d85a6c9-6d, col_values=(('qos', UUID('6b1632bc-ef7d-4775-9f85-872daf32180a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.474959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d85a6c9-6d, col_values=(('external_ids', {'iface-id': '4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:7b:ea', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.480751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.496342 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.497036 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d')
Jun 26 02:46:01.497731 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.497896 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.498356 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.498615 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.498931 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.499446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.499714 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.500596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.500818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfc537ae-d26a-55a4-8bdb-1fe15a7ec1d5', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.502535 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.518717 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.521069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.521311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7c33687-ea, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.521789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7c33687-ea, col_values=(('qos', UUID('ccdd8386-3377-4aa9-9072-96546bbe726f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.522016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7c33687-ea, col_values=(('external_ids', {'iface-id': 'c7c33687-ea16-4c3a-a1cf-e5ab51039f82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:c6:47', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.525036 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.546240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.547637 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea')
Jun 26 02:46:01.548555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.548779 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.549392 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.549702 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.549958 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.550178 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.550393 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.551335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.551997 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8d501c3-ed3f-5bdb-8974-1b0c57a3afe8', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.552562 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:01.555433 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.556519 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.578375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.581951 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.582171 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58eb4121-75, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.582575 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58eb4121-75, col_values=(('qos', UUID('a27a129d-0cb9-4335-9029-1387b31f7962')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.582766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58eb4121-75, col_values=(('external_ids', {'iface-id': '58eb4121-75dd-45b6-a7bd-34b53605d00d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:5f:24', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.583722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.585253 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.592734 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Attempting rescue
Jun 26 02:46:01.593320 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:46:01.599299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:46:01.599473 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Creating image(s)
Jun 26 02:46:01.600191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.600354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.600909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:01.601122 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'trusted_certs' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:01.617926 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.618807 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75')
Jun 26 02:46:01.619621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.619769 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.620324 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.620399 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.620602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.620774 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.620943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.621640 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.621821 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f256050-d737-5fa5-a262-37ea2b13ae68', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.623292 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.624367 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.650256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.652699 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.652916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf55cc07d-ec, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.653304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf55cc07d-ec, col_values=(('qos', UUID('2056608a-e18e-48b7-b1f6-32e89f702fcc')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.653519 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf55cc07d-ec, col_values=(('external_ids', {'iface-id': 'f55cc07d-ec85-458d-a717-ae68d3c27ab8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:31:f9', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.654951 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.657031 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.686222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.687203 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec')
Jun 26 02:46:01.687823 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:01.687979 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:01.688388 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:01.688622 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:01.688780 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.688913 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.689052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:01.689809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.689934 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e529ff19-c495-5774-99c6-9c28ffbcc3b9', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.690447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.691606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.721964 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.723314 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.725348 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.725494 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92f2b92b-e7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.725765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92f2b92b-e7, col_values=(('qos', UUID('cc0c7b76-2e12-4c0a-b08e-299bac796f31')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.725900 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92f2b92b-e7, col_values=(('external_ids', {'iface-id': '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d5:a3', 'vm-uuid': '00f46ba2-9383-40fb-af68-61fe8d692c6d'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:01.726637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.727747 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:01.766275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:01.767282 np0000003683 nova-compute[98991]: INFO os_vif [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7')
Jun 26 02:46:01.917242 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:01.956978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:01.957332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:01.960904 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:01.961143 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Claim successful on node np0000003683
Jun 26 02:46:02.102863 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updated VIF entry in instance network info cache for port 92fe4ccc-62d5-475f-b0f5-74afdb1321fe. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:02.103386 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:02.103658 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updating instance_info_cache with network_info: [{"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:02.105939 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:02.108726 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:02.109692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:02.109996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:02.110255 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:02.113140 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:02.113616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:02.220990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:02.221428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:02.288804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.rescue" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:02.289298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:02.289656 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'migration_context' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:02.606165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f4f7da6b-b64a-4924-bd39-2364fbf3c3b3 req-d6b0f281-c288-44ee-b174-68e488a369fb service nova] Releasing lock "refresh_cache-a39d0d03-58af-46e4-b549-78cf284446c0" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:02.792657 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:02.793267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:02.793888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start _get_guest_xml network_info=[{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:e5:78:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:02.793888 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:03.174693 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:03.174842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:03.175023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:03.175179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:03.175273 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:03.175387 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-36d71d4d-d8e2-4441-bc9e-d90fa18fc400 req-42873e5d-41d9-4b67-ab06-8c15937f7a15 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state active and task_state rescuing.
Jun 26 02:46:03.293795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:03.294109 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:03.294215 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] No VIF found with MAC fa:16:3e:c8:09:c2, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:03.294441 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] No VIF found with MAC fa:16:3e:75:5f:24, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:03.297122 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:03.299613 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:03.300932 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Using config drive
Jun 26 02:46:03.307718 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1145245523', uuid='121ec5e6-08cf-4e0c-9c89-e2be23a274be'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:e5:78:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441963.300579) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:03.311677 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:03.312010 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:03.313933 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:03.314088 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:03.315388 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:03.315730 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:03.315926 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:03.316037 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:03.316161 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:03.316245 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:03.316338 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:03.316468 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:03.316683 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:03.316792 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:03.316991 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:03.317179 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:03.317309 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'vcpu_model' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:03.376802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:03.377057 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:03.581367 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:03.581735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:03.581884 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Shelving
Jun 26 02:46:03.810149 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:03.820033 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:03.830012 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1145245523',display_name='tempest-ServerRescueNegativeTestJSON-server-1145245523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1145245523',id=30,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:35Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-o4z3j5hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:45:36Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=121ec5e6-08cf-4e0c-9c89-e2be23a274be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:e5:78:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:03.830228 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:e5:78:7d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:03.830818 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:03.831304 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:03.879910 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:03.926239 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Creating config drive at /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/disk.config
Jun 26 02:46:03.929808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy8jx0rdl {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:03.984872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy8jx0rdl" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:04.333239 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <uuid>121ec5e6-08cf-4e0c-9c89-e2be23a274be</uuid>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <name>instance-0000001e</name>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1145245523</nova:name>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:03</nova:creationTime>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         <nova:port uuid="ff2ad29d-7b0f-4c47-a3d3-966e884feec6">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="serial">121ec5e6-08cf-4e0c-9c89-e2be23a274be</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="uuid">121ec5e6-08cf-4e0c-9c89-e2be23a274be</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.rescue"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config.rescue"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e5:78:7d"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <target dev="tapff2ad29d-7b"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/console.log" append="off"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:04.334577 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:04.342525 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance destroyed successfully.
Jun 26 02:46:04.390954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.434s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:04.391383 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:04.434167 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.496010 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.546028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.657948 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.679670 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e88406f5-0765-499c-a59d-b8bad1e6f0c7 req-0172f6f8-1baa-4a40-ba6d-4df4ae6b443c service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:04.680682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e88406f5-0765-499c-a59d-b8bad1e6f0c7 req-0172f6f8-1baa-4a40-ba6d-4df4ae6b443c service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:04.680682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e88406f5-0765-499c-a59d-b8bad1e6f0c7 req-0172f6f8-1baa-4a40-ba6d-4df4ae6b443c service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:04.680682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e88406f5-0765-499c-a59d-b8bad1e6f0c7 req-0172f6f8-1baa-4a40-ba6d-4df4ae6b443c service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:04.680682 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e88406f5-0765-499c-a59d-b8bad1e6f0c7 req-0172f6f8-1baa-4a40-ba6d-4df4ae6b443c service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:04.697757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.703887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.761013 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.778606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.807031 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.814623 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.865112 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.874718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.890162 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.898282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:04.898516 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:04.900150 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:04.901116 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:04.915698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.966440 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:04.971170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.047980 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.058553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.075521 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b19b282009bd41bd924982574984e524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f149d284f0d24070afe71cccd4c0c744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:05.145723 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.152722 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99665013899994 future=<Future at 0x72e29c4afdd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:05.157101 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance destroyed successfully.
Jun 26 02:46:05.157511 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'numa_topology' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:05.177159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d1e87e6f-5fd1-4058-9582-71faff90fe2d req-b2ce666f-adae-4a0a-a881-a63a70e66e20 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:05.177685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1e87e6f-5fd1-4058-9582-71faff90fe2d req-b2ce666f-adae-4a0a-a881-a63a70e66e20 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:05.177867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1e87e6f-5fd1-4058-9582-71faff90fe2d req-b2ce666f-adae-4a0a-a881-a63a70e66e20 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:05.177996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d1e87e6f-5fd1-4058-9582-71faff90fe2d req-b2ce666f-adae-4a0a-a881-a63a70e66e20 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:05.178114 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d1e87e6f-5fd1-4058-9582-71faff90fe2d req-b2ce666f-adae-4a0a-a881-a63a70e66e20 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:05.198465 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f14aa2a6-c79a-4db3-8e93-2684f9918191 req-10e93684-a7dd-4726-b7e9-36bed7abbd80 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:05.201566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f14aa2a6-c79a-4db3-8e93-2684f9918191 req-10e93684-a7dd-4726-b7e9-36bed7abbd80 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:05.201566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f14aa2a6-c79a-4db3-8e93-2684f9918191 req-10e93684-a7dd-4726-b7e9-36bed7abbd80 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:05.201566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f14aa2a6-c79a-4db3-8e93-2684f9918191 req-10e93684-a7dd-4726-b7e9-36bed7abbd80 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:05.201566 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f14aa2a6-c79a-4db3-8e93-2684f9918191 req-10e93684-a7dd-4726-b7e9-36bed7abbd80 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:05.208939 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.323316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.334924 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.378219 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.404300 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:05.458562 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.459683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.477711 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.480567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.517191 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.529914 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.605528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d87ede31-3d13-4f58-82bd-63bfd510e572 req-dce92981-ea2a-4f4a-b558-9ba67069148f service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:05.605702 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d87ede31-3d13-4f58-82bd-63bfd510e572 req-dce92981-ea2a-4f4a-b558-9ba67069148f service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:05.605853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d87ede31-3d13-4f58-82bd-63bfd510e572 req-dce92981-ea2a-4f4a-b558-9ba67069148f service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:05.605972 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d87ede31-3d13-4f58-82bd-63bfd510e572 req-dce92981-ea2a-4f4a-b558-9ba67069148f service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:05.606094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d87ede31-3d13-4f58-82bd-63bfd510e572 req-dce92981-ea2a-4f4a-b558-9ba67069148f service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:05.675853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.719360 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.798021 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Beginning cold snapshot process
Jun 26 02:46:05.861055 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:05.861543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:05.861543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:05.861625 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:e5:78:7d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:05.862201 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Using config drive
Jun 26 02:46:05.907539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:05.956600 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:05.967385 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.070543 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Successfully created port: 123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:06.143416 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.155071 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.279388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:06.279664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:06.297181 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441966.296748, 00f46ba2-9383-40fb-af68-61fe8d692c6d => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:06.297630 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] VM Started (Lifecycle Event)
Jun 26 02:46:06.351077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.363792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.369051 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'ec2_ids' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:06.645402 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Successfully updated port: 123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:06.682320 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.692372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.696654 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.726540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.727767 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.740547 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:06.783748 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:06.783748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:06.783827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:06.784404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:06.784625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 in dict_keys([('network-vif-plugged', '4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38'), ('network-vif-plugged', 'f55cc07d-ec85-458d-a717-ae68d3c27ab8'), ('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:06.784777 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-4c428988-ac19-4dba-8540-640346338513 for instance with vm_state building and task_state spawning.
Jun 26 02:46:06.784922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:06.785065 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:06.785640 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:06.786041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:06.786198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:06.786361 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received unexpected event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with vm_state active and task_state shelving_image_uploading.
Jun 26 02:46:06.786541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:06.786740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:06.786881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:06.787024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:06.787176 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:06.788892 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-93697fe3-2539-401c-9ec0-0b239c608ec5 req-5034e458-a0b4-4355-b17d-0aa9ac8b5ef1 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received unexpected event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with vm_state active and task_state shelving_image_uploading.
Jun 26 02:46:06.791348 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:06.802575 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:06.814893 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441966.8108473, 00f46ba2-9383-40fb-af68-61fe8d692c6d => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:06.815075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] VM Paused (Lifecycle Event)
Jun 26 02:46:06.876103 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:06.876644 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'keypairs' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:06.918349 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:06.919179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:06.919383 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Creating image(s)
Jun 26 02:46:06.920017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:06.920190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:06.921904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:06.922733 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:06.926195 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:06.927341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.001514 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:07.011852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:07.035129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.108s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.035653 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.036148 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.036679 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:07.039569 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:07.039990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.112768 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0009077939998860529 future=<Future at 0x72e29c2080e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:07.112932 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:07.113132 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.5675690269999905 future=<Future at 0x72e27c2c7350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:07.113251 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.567431501999863 future=<Future at 0x72e27c2c7350 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:07.116593 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782441952.1117036, ed3b38c4-c012-4f44-8801-8bc21e30c0c5 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:07.116593 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] VM Stopped (Lifecycle Event)
Jun 26 02:46:07.142821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.142821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.164085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:07.166732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquired lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:07.168438 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:07.188402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:07.206106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk 1073741824" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.206565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.206931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.255058 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.255323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.257588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.258368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.258592 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 in dict_keys([('network-vif-plugged', '4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38'), ('network-vif-plugged', 'f55cc07d-ec85-458d-a717-ae68d3c27ab8'), ('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:07.258748 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.258915 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.259085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.259237 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.259384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.259576 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:07.259757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.259944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.260102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.260235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.260388 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 in dict_keys([('network-vif-plugged', '4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38'), ('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:07.260556 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d7fa42b5-c105-4ce8-873b-42d95acfdd58 req-b4e9162a-7e8b-474c-9763-53402c8f91e0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.287102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.287272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.287398 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.287547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.287688 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea in dict_keys([('network-vif-plugged', '4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38'), ('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:07.287824 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.287959 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.288103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.288253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.288520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.288565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:07.288765 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.288909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.289043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.289174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.289299 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 in dict_keys([('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:07.289428 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.291194 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received event network-changed-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.292740 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Refreshing instance network info cache due to event network-changed-123f28d0-45a7-49ba-a7d6-4a48ecc742bb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:07.292916 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Acquiring lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:07.306673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.307345 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:46:07.307851 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.329535 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:07.330757 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:46:07.331494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk /opt/stack/data/nova/instances/snapshots/tmpdh7gv9cw/eecddc54e1dd4b05ae73eba4b7903f97 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.360081 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:07.380215 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:07.384920 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:07.407602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.408514 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Cannot resize image /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:46:07.409739 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:07.409912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Ensure instance console log exists: /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:07.410612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.411114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.411700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.524603 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Creating config drive at /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config.rescue
Jun 26 02:46:07.529202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2blp4z1o {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:07.580172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2blp4z1o" returned: 0 in 0.051s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.610385 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk /opt/stack/data/nova/instances/snapshots/tmpdh7gv9cw/eecddc54e1dd4b05ae73eba4b7903f97" returned: 0 in 0.279s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:07.610863 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Snapshot extracted, beginning image upload
Jun 26 02:46:07.619324 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: ed3b38c4-c012-4f44-8801-8bc21e30c0c5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:07.677145 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.683384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.683686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.683859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.684020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No event matching network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d in dict_keys([('network-vif-plugged', '92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:46:07.684187 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-58eb4121-75dd-45b6-a7bd-34b53605d00d for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.684310 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.684447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.684654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.684832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.684978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Processing event network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:07.685167 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:07.685324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:07.685494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:07.685676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.685798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:07.685910 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c5c86eba-e00e-4fd4-a18a-ba0545c90b4f req-8c760e90-9454-4fad-854e-ce1f7ba64a7b service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received unexpected event network-vif-plugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 for instance with vm_state building and task_state spawning.
Jun 26 02:46:07.687231 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:07.692971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:07.696409 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance spawned successfully.
Jun 26 02:46:07.696855 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:07.726597 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:46:07.758102 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:07.798251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:07.865020 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:46:07.865346 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441967.8651552, 00f46ba2-9383-40fb-af68-61fe8d692c6d => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:07.865526 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] VM Resumed (Lifecycle Event)
Jun 26 02:46:07.921352 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:08.071938 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:08.095819 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating instance_info_cache with network_info: [{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:08.113116 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:08.179061 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.214573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:08.249597 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:08.260206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:08.369495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:08.377819 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:08.599042 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Releasing lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:08.599370 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Instance network_info: |[{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:08.601222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Start _get_guest_xml network_info=[{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:08.601694 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Acquired lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:08.601888 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Refreshing network info cache for port 123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:08.606013 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:08.607378 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-958007171', uuid='be25294a-11d9-453a-8fc1-9ffc77dbc4a7'), owner=OwnerMeta(userid='b19b282009bd41bd924982574984e524', username='tempest-AttachVolumeTestJSON-391502958-project-member', projectid='f149d284f0d24070afe71cccd4c0c744', projectname='tempest-AttachVolumeTestJSON-391502958'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441968.6069071) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:08.609743 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:08.610773 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:08.611900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:08.612133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:08.613248 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:08.613657 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:08.613873 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:08.614027 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:08.614244 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:08.614676 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:08.614959 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:08.615174 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:08.615329 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:08.615533 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:08.615694 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:08.615851 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:08.629128 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-958007171',display_name='tempest-AttachVolumeTestJSON-server-958007171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-958007171',id=35,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRvLv1El4K7oltnvKzthKknDEgNInFAUrpgH2pB9m49OAZHBXPtRLSR52EexyfK91Vqhd6ZZ9lp2HoT1Hid5tWXfSJFKhl9AhnsAsTOxm7f9Xe8VMgJHkjPyEJ/S6jOQ==',key_name='tempest-keypair-2056094544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-z6y5lw17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=be25294a-11d9-453a-8fc1-9ffc77dbc4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:08.629350 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:08.630120 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:08.630744 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'pci_devices' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:08.682087 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0010941900000034366 future=<Future at 0x72e27c2c7350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:08.683103 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:08.684506 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.401257657000087 future=<Future at 0x72e2b3d9c590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:08.684506 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.401109582000117 future=<Future at 0x72e2b3d9c590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:08.686190 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] Emitting event <LifecycleEvent: 1782441953.6806126, cb30fcf0-34d3-4008-b128-9bd46080c204 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:08.686427 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] VM Stopped (Lifecycle Event)
Jun 26 02:46:08.720609 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Took 26.95 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:08.720865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:08.876437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:08.877455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:08.877710 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Attaching volume 8abee0bb-859a-4368-8e46-b3a9382f36a6 to /dev/vdb
Jun 26 02:46:08.882224 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:46:08.940989 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:08.956157 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:08.971227 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 121ec5e6-08cf-4e0c-9c89-e2be23a274be due to new event <LifecycleEvent: 1782441968.9708498, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:46:08.972881 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441968.9708498, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:08.973752 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Resumed (Lifecycle Event)
Jun 26 02:46:08.975811 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6bc3da9c-ffe8-49cb-9221-f23b58469bf9 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:08.986588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:09.034534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:09.034859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:09.047518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:09.050736 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:feec:5477', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee7:d496', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fec8:9c2', 'fe80::f42f:a9ff:fef7:8092', 'fe80::fc16:3eff:fecd:fd01', 'fe80::fc16:3eff:fe45:7bea', 'fe80::fc16:3eff:fe6c:c647', 'fe80::fc16:3eff:fe75:5f24', 'fe80::e899:83ff:fe2e:3b7b', 'fe80::fc16:3eff:fe44:31f9', 'fe80::fc16:3eff:fe57:d5a3', 'fe80::818:d3ff:fe89:5917', 'fe80::fc16:3eff:fee5:787d'] 
Jun 26 02:46:09.050989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:09.051504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:09.051869 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:09.052202 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updating existing volume attachment record: 1d195878-151b-45a6-b468-93161c4e7635 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:09.107132 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <uuid>be25294a-11d9-453a-8fc1-9ffc77dbc4a7</uuid>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <name>instance-00000023</name>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeTestJSON-server-958007171</nova:name>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:08</nova:creationTime>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:user uuid="b19b282009bd41bd924982574984e524">tempest-AttachVolumeTestJSON-391502958-project-member</nova:user>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:project uuid="f149d284f0d24070afe71cccd4c0c744">tempest-AttachVolumeTestJSON-391502958</nova:project>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         <nova:port uuid="123f28d0-45a7-49ba-a7d6-4a48ecc742bb">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="serial">be25294a-11d9-453a-8fc1-9ffc77dbc4a7</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="uuid">be25294a-11d9-453a-8fc1-9ffc77dbc4a7</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.config"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e8:88:d5"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <target dev="tap123f28d0-45"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/console.log" append="off"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:09.135106 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Preparing to wait for external event network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-958007171',display_name='tempest-AttachVolumeTestJSON-server-958007171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-958007171',id=35,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRvLv1El4K7oltnvKzthKknDEgNInFAUrpgH2pB9m49OAZHBXPtRLSR52EexyfK91Vqhd6ZZ9lp2HoT1Hid5tWXfSJFKhl9AhnsAsTOxm7f9Xe8VMgJHkjPyEJ/S6jOQ==',key_name='tempest-keypair-2056094544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-z6y5lw17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=be25294a-11d9-453a-8fc1-9ffc77dbc4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.147283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b98b1a5-5abe-5097-beea-837d41a98dce', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:09.155368 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.156398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:09.161365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.167731 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.167971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap123f28d0-45, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:09.169085 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap123f28d0-45, col_values=(('qos', UUID('6a49e37f-8f28-4b6e-bd23-91f236a92d85')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:09.169085 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap123f28d0-45, col_values=(('external_ids', {'iface-id': '123f28d0-45a7-49ba-a7d6-4a48ecc742bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:88:d5', 'vm-uuid': 'be25294a-11d9-453a-8fc1-9ffc77dbc4a7'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:09.171944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.174336 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:09.183103 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:09.184364 np0000003683 nova-compute[98991]: INFO os_vif [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45')
Jun 26 02:46:09.190611 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c8c05773-4214-4ad6-af54-17827b5e7e68 tempest-ServerStableDeviceRescueTest-502021662 tempest-ServerStableDeviceRescueTest-502021662-project-member] [instance: cb30fcf0-34d3-4008-b128-9bd46080c204] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:09.235153 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Took 39.65 seconds to build instance.
Jun 26 02:46:09.462998 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:09.485643 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:09.491627 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:09.614508 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updated VIF entry in instance network info cache for port 123f28d0-45a7-49ba-a7d6-4a48ecc742bb. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:09.614508 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating instance_info_cache with network_info: [{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:09.618827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:09.619251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:09.619548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:09.620102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:09.620439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:09.636504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:09.636504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:09.638678 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:09.641402 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:09.644410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.010s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:09.644932 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:09.657756 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:09.657756 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:09.664570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:09.664570 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6] added
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:09.671400 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:09.671688 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:09.671770 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:09.671933 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6] added
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:09.678146 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:09.678344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:09.678516 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:09.678615 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:09.738918 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:09.743999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7bdf160b-28a5-4c16-abdd-74ef3d5b645d tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:09.744368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:09.744737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:09.744934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:09.745124 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:09.745313 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state rescued and task_state None.
Jun 26 02:46:09.745488 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:09.745706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:09.745860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:09.746005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:09.746157 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:09.746318 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d5962eb5-23fc-49b1-b2dc-f2e47cea3ff1 req-9e10464b-de70-460b-be96-f08540d2751f service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state rescued and task_state None.
Jun 26 02:46:09.994078 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441969.9937057, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:09.994608 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Started (Lifecycle Event)
Jun 26 02:46:10.051425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-changed-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:10.051595 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing instance network info cache due to event network-changed-4c428988-ac19-4dba-8540-640346338513. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:10.051777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] Acquiring lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:10.051891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] Acquired lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:10.052042 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Refreshing network info cache for port 4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:10.116406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-16ec3d29-5227-4571-9d62-1ea867df5b51 req-22e72e71-5e25-4e9c-a2ff-d25dc635a137 service nova] Releasing lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:10.438224 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Snapshot image upload complete
Jun 26 02:46:10.438508 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:10.496626 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:10.497933 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:10.560255 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:10.672360 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:10.679155 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:10.687460 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:10.700037 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.705130 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.708299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:10.708457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:10.708634 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:e8:88:d5, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:10.709161 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Using config drive
Jun 26 02:46:10.712346 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.725175 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.725457 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.732079 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.732352 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:10.739344 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Unrescuing
Jun 26 02:46:10.739344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:10.739441 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:10.739595 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:10.776000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:10.776374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.40.100,3260]
Jun 26 02:46:10.776374 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:10.776374 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.776649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:10.778260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.50.100,3260]
Jun 26 02:46:10.778260 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:10.778260 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.790275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.799906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.806935 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.807309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:10.807552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:10.807552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:10.808296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('13', '-', '-', 0) found on session 64 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:10.808422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.818518 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:10.818912 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:10.819418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:10.819418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:10.820262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('14', '-', '-', 0) found on session 65 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:10.820330 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:10.824546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 64 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:10.826705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:10.838313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 65 and hctl ['14', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:10.926925 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:10.945879 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Shelve offloading
Jun 26 02:46:11.000189 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:46:11.088704 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updated VIF entry in instance network info cache for port 4c428988-ac19-4dba-8540-640346338513. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:11.089410 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [{"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:11.219500 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:11.242686 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:11.279385 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:11.349396 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Creating config drive at /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.config
Jun 26 02:46:11.354449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqr1azcvn {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:11.407887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqr1azcvn" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:11.454170 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance destroyed successfully.
Jun 26 02:46:11.454417 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:11.455815 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:11.455958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:11.456119 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:11.565677 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:11.592120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83ed69e7-c565-4bf9-8c6c-d113370e278a req-f18b1911-25a6-46cf-8174-1b7d2bb9f7c0 service nova] Releasing lock "refresh_cache-00f46ba2-9383-40fb-af68-61fe8d692c6d" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:11.690328 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Updating instance_info_cache with network_info: [{"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:11.742040 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:11.825899 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:11.842050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:11.842347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:11.843593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 65 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:11.843769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:11.846740 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:11.846852 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Claim successful on node np0000003683
Jun 26 02:46:11.867999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:11.874916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:11.958002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:11.963937 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:12.194049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-121ec5e6-08cf-4e0c-9c89-e2be23a274be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:12.194049 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'flavor' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:12.221594 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.228871 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.231859 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.240621 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a3d788c-112b-4aca-ba75-ff94a654cb4b req-018e28f9-4a6c-4ff6-a079-018981ead247 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received event network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:12.240928 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a3d788c-112b-4aca-ba75-ff94a654cb4b req-018e28f9-4a6c-4ff6-a079-018981ead247 service nova] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:12.241280 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a3d788c-112b-4aca-ba75-ff94a654cb4b req-018e28f9-4a6c-4ff6-a079-018981ead247 service nova] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:12.241383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a3d788c-112b-4aca-ba75-ff94a654cb4b req-018e28f9-4a6c-4ff6-a079-018981ead247 service nova] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:12.241615 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a3d788c-112b-4aca-ba75-ff94a654cb4b req-018e28f9-4a6c-4ff6-a079-018981ead247 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Processing event network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:12.259048 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.452698 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:12.584903 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:12.660349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found WWN 330000000fef7e5af for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:12.661044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:12.661201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000fef7e5af', 'path': '/dev/dm-5', 'multipath_id': '330000000fef7e5af'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:12.661330 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fef7e5af', 'path': '/dev/dm-5', 'multipath_id': '330000000fef7e5af'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:12.665030 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:12.725163 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.728563 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.755562 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.805743 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441972.8051422, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:12.805893 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] VM Started (Lifecycle Event)
Jun 26 02:46:12.807504 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:12.809950 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:12.820730 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Instance spawned successfully.
Jun 26 02:46:12.822132 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:12.872632 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:12.873007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:12.873596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:12.874083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:12.874083 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:12.874083 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d0dff5f3-0ccd-4039-bc15-21169665f45c req-2090b6f9-ba60-40fe-ad6f-181d90cd003a service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:46:12.910902 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:12.924685 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:13.052995 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance destroyed successfully.
Jun 26 02:46:13.053533 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'numa_topology' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:13.086993 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:13.087225 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:13.087425 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:13.170070 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Attempting to attach volume 8abee0bb-859a-4368-8e46-b3a9382f36a6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:   <alias name="ua-8abee0bb-859a-4368-8e46-b3a9382f36a6"/>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:   <serial>8abee0bb-859a-4368-8e46-b3a9382f36a6</serial>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:13.171659 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:46:13.309853 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:13.313505 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:13.327991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.328344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.328715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.328912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.329162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.329442 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:13.413403 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:13.413624 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:13.555618 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<121ec5e6-08cf-4e0c-9c89-e2be23a274be> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:13.692378 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance destroyed successfully.
Jun 26 02:46:13.692964 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'resources' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:13.748785 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:13.748785 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing instance network info cache due to event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:13.748785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:13.748785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:13.748785 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:13.813858 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:46:13.814108 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441973.8138788, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:13.814290 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] VM Paused (Lifecycle Event)
Jun 26 02:46:13.834123 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Took 6.92 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:13.834123 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:13.917630 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:14.001328 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.044504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.131018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.170425 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.194918 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:14.195610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvO1UHKROvy+5e2T1Ppg7iE9fMVkvTm1AL8Lz0UEpfobDil5CPz9RWu5Fcqtg+lxa0qxeI7Eo8xysl2p+txVpAb4hX8kx55VqbzJLsN42CSxsPBDT6c0nsE0pADs7dQag==',key_name='tempest-keypair-1639916074',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:23Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:46:10.438263',shelved_host='np0000003683',shelved_image_id='7701802e-eb39-4e59-b935-bd9c5434b40b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:14.195787 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:14.196455 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:14.196725 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:14.198009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.198318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d73365b-ab, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:14.199616 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.200680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:14.201735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.202752 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.205030 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff2a015-6f9d-4e27-a242-11b9b702172f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:14.205564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.206105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:14.206402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:14.208363 np0000003683 nova-compute[98991]: INFO os_vif [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab')
Jun 26 02:46:14.209380 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Deleting instance files /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb_del
Jun 26 02:46:14.214235 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Deletion of /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb_del complete
Jun 26 02:46:14.250902 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:14.309264 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received event network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:14.309488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:14.310145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:14.310145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.310145 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] No waiting events found dispatching network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:14.310145 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-66e4a1d8-9f85-4e61-8cb3-fc027fdab11a req-ed9773b2-c397-4e2d-9ee1-c905f6473c06 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received unexpected event network-vif-plugged-123f28d0-45a7-49ba-a7d6-4a48ecc742bb for instance with vm_state active and task_state None.
Jun 26 02:46:14.317281 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:14.319043 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441974.3187966, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:14.319366 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] VM Resumed (Lifecycle Event)
Jun 26 02:46:14.344022 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Took 12.46 seconds to build instance.
Jun 26 02:46:14.429727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.587s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.430067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:14.594835 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:14.739600 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updated VIF entry in instance network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:14.740133 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d73365b-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:14.790795 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Deleted allocations for instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb
Jun 26 02:46:14.821331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:14.825577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:14.827019 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:14.827131 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:14.827245 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:14.827366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:f5:b8:6d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:14.845647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.971s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.846555 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ce5aad2f-b7e5-4a89-96b2-a37a684e76de tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:14.933660 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:14.934266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:14.934519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:14.934714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.934906 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:14.934981 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state active and task_state None.
Jun 26 02:46:14.935131 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:14.935303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:14.935525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:14.935624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.935758 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:14.935900 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state active and task_state None.
Jun 26 02:46:14.936038 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:14.936192 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:14.936354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:14.936524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:14.938801 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:14.938973 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ff55fec1-757d-421e-ac14-bdb4f5a7f7be req-21ca521d-8bb8-4689-91a9-e649b99c52c0 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received unexpected event network-vif-plugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with vm_state active and task_state None.
Jun 26 02:46:14.942018 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:14.942416 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:14.942729 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:14.942892 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:15.045659 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:15.242333 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0a07978e-d133-4c3b-85ca-a40be46ed19a req-6e31f99b-7eba-4d3b-8174-3d0036d0a438 service nova] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:15.296336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:15.296549 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:15.334571 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999696094 future=<Future at 0x72e29c230ce0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:15.335054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 121ec5e6-08cf-4e0c-9c89-e2be23a274be due to new event <LifecycleEvent: 1782441975.3346715, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:46:15.335054 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441975.3346715, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:15.335225 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Resumed (Lifecycle Event)
Jun 26 02:46:15.442720 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:15.461649 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Successfully created port: 91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:15.823641 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:15.823641 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:15.839638 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:15.844237 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:15.947914 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:16.011749 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Successfully updated port: 91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:16.063759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-changed-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:16.063759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Refreshing instance network info cache due to event network-changed-91f954d1-a626-4f25-b4c3-6506911b864d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:16.063759 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] Acquiring lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:16.063759 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] Acquired lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:16.063759 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Refreshing network info cache for port 91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:16.087419 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0019372760000351263 future=<Future at 0x72e2b3d9c590 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:16.087544 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:16.087656 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.06162415599988 future=<Future at 0x72e29c4afdd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:16.087743 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.061533336999901 future=<Future at 0x72e29c4afdd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:16.326748 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:16.347199 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441976.3469098, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:16.347691 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Started (Lifecycle Event)
Jun 26 02:46:16.389134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received event network-changed-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:16.389134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Refreshing instance network info cache due to event network-changed-123f28d0-45a7-49ba-a7d6-4a48ecc742bb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:16.389134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] Acquiring lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:16.389134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] Acquired lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:16.389134 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Refreshing network info cache for port 123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:16.401880 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e35661b8-19b9-499b-b98a-cc02e7546f50 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.524s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:16.452624 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Booting with volume fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 at /dev/vda
Jun 26 02:46:16.508125 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:16.513493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:16.522503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:16.540084 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:16.570643 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:16.583702 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:16.584041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:16.597947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:16.599641 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:feec:5477', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee7:d496', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fec8:9c2', 'fe80::f42f:a9ff:fef7:8092', 'fe80::fc16:3eff:fecd:fd01', 'fe80::fc16:3eff:fe45:7bea', 'fe80::fc16:3eff:fe6c:c647', 'fe80::fc16:3eff:fe75:5f24', 'fe80::e899:83ff:fe2e:3b7b', 'fe80::fc16:3eff:fe44:31f9', 'fe80::fc16:3eff:fe57:d5a3', 'fe80::818:d3ff:fe89:5917', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d'] 
Jun 26 02:46:16.599778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:16.599877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:16.600178 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:16.600631 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Updating existing volume attachment record: 29c68d14-27a0-4c01-925f-7ca0ff9a5a87 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:16.644683 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:16.745366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:16.815417 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:16.833262 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.537s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:16.849532 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:16.852025 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:16.892507 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:16.971430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:16.971726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:17.277223 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:17.317469 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b8efd4c8-2c85-426e-a4f8-4e8cf479986c req-7cb5f4d4-53bc-4386-9d7d-62644b033ded service nova] Releasing lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:17.317911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:17.318073 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:17.339959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-831e8bb5-d665-48a8-b3fd-c8215ae066b6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.758s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:17.430575 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updated VIF entry in instance network info cache for port 123f28d0-45a7-49ba-a7d6-4a48ecc742bb. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:17.430951 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating instance_info_cache with network_info: [{"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:17.478854 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Detaching volume 8abee0bb-859a-4368-8e46-b3a9382f36a6
Jun 26 02:46:17.513136 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Attempting to driver detach volume 8abee0bb-859a-4368-8e46-b3a9382f36a6 from mountpoint /dev/vdb
Jun 26 02:46:17.519684 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-8abee0bb-859a-4368-8e46-b3a9382f36a6 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:17.520609 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-8abee0bb-859a-4368-8e46-b3a9382f36a6 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:17.520716 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Attempting to detach device vdb from instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <alias name="ua-8abee0bb-859a-4368-8e46-b3a9382f36a6"/>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <serial>8abee0bb-859a-4368-8e46-b3a9382f36a6</serial>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:17.520930 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:17.526635 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 from the persistent domain config.
Jun 26 02:46:17.526808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] (1/8): Attempting to detach device vdb with device alias ua-8abee0bb-859a-4368-8e46-b3a9382f36a6 from instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <alias name="ua-8abee0bb-859a-4368-8e46-b3a9382f36a6"/>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <serial>8abee0bb-859a-4368-8e46-b3a9382f36a6</serial>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:17.527039 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:17.894756 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:17.933058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8e3a3ba4-08ff-45ac-869e-2d15ecb65372 req-0216aaf2-c9c5-46ae-8e8a-f7c0b30de168 service nova] Releasing lock "refresh_cache-be25294a-11d9-453a-8fc1-9ffc77dbc4a7" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:18.010457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782441978.0100548, 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 => ua-8abee0bb-859a-4368-8e46-b3a9382f36a6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:46:18.011350 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8abee0bb-859a-4368-8e46-b3a9382f36a6 for instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:46:18.013777 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 from the live domain config.
Jun 26 02:46:18.017230 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:18.017372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:18.017544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:18.017898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:18.018190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8abee0bb-859a-4368-8e46-b3a9382f36a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:18.018315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:18.043017 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6 (non-flash)
Jun 26 02:46:18.043212 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:18.043393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', '65')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:18.043393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', '64')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:18.044465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6', '65')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:18.044996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c31b100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:18.045182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:18.045378 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flush multipath device 330000000fef7e5af {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:18.067572 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:18.088137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:18.095543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:18.095784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:18.095976 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Unshelving
Jun 26 02:46:18.131253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:18.178621 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:18.178801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:18.181569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:18.192959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:18.193210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:18.203913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.214411 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Updating instance_info_cache with network_info: [{"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:18.243681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.40.100,3260]
Jun 26 02:46:18.243681 np0000003683 nova-compute[98991]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:18.243681 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.263563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.277262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.313070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.50.100,3260]
Jun 26 02:46:18.313070 np0000003683 nova-compute[98991]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-8abee0bb-859a-4368-8e46-b3a9382f36a6, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:18.313070 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.328444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.328683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:18.328791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== disconnect_volume: return (311ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:18.328890 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:18.719701 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-fbf319d1-e938-4727-8ed3-2275ec9bd8c2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:18.721596 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:18.723766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance network_info: |[{"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:18.724182 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:18.724551 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Creating image(s)
Jun 26 02:46:18.724925 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:46:18.725110 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Ensure instance console log exists: /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:18.725365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:18.725583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:18.725703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:18.726208 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Start _get_guest_xml network_info=[{"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '29c68d14-27a0-4c01-925f-7ca0ff9a5a87', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fbf319d1-e938-4727-8ed3-2275ec9bd8c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'serial': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'multiattach': True}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:18.728992 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:18.730031 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1547132050', uuid='fbf319d1-e938-4727-8ed3-2275ec9bd8c2'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441978.7297466) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:18.731752 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:18.732088 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:18.732992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:18.733190 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:18.734191 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:18.734611 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:18.734782 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:18.734848 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:18.734969 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:18.735067 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:18.735145 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:18.735288 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:18.735410 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:18.735552 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:18.735683 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:18.735796 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:18.746278 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:18.746540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:18.746647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:18.747022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:18.747212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:18.760017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:18.760737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:18.761110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:18.761416 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:18.761864 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:18.762104 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:18.772158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:18.772158 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.778491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:18.778491 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9] added
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:18.785393 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.785641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:18.785702 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:18.785836 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9] added
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:18.790749 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:18.790904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:18.791000 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:18.791159 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:18.874943 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:19.139638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:19.139826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:19.205672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:19.613219 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Booting with volume 0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 at /dev/vdc
Jun 26 02:46:19.641317 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:19.679224 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:19.691273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:19.712919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:19.751564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:19.751564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:19.760950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:19.762821 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fef5:b86d', 'fe80::e879:ebff:fecc:9ff0', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:feec:5477', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee7:d496', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fec8:9c2', 'fe80::f42f:a9ff:fef7:8092', 'fe80::fc16:3eff:fecd:fd01', 'fe80::fc16:3eff:fe45:7bea', 'fe80::fc16:3eff:fe6c:c647', 'fe80::fc16:3eff:fe75:5f24', 'fe80::e899:83ff:fe2e:3b7b', 'fe80::fc16:3eff:fe44:31f9', 'fe80::fc16:3eff:fe57:d5a3', 'fe80::818:d3ff:fe89:5917', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d'] 
Jun 26 02:46:19.763300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:19.763549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:19.764406 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:19.764800 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating existing volume attachment record: d698c7d4-18e4-4942-b4ee-53ab9c385069 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:19.789160 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:19.791623 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:19.802200 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:19.813096 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.819417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.825908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.837067 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.837385 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.844271 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.844628 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:19.876906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.40.100,3260]
Jun 26 02:46:19.876906 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:19.876906 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.881127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca98dbd1-4f4f-4930-97aa-352ff0e3f64d tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.909s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:19.888911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.891105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.50.100,3260]
Jun 26 02:46:19.891105 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:19.891105 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.909690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.910692 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.911007 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:19.911228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:19.911315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:19.914619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('13', '-', '-', 0) found on session 66 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:19.914849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:19.928702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 66 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:19.928926 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.930687 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:19.930970 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:19.931268 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:19.931268 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:19.932164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('14', '-', '-', 0) found on session 67 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:19.932277 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:19.945509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 67 and hctl ['14', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:20.150407 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0010732030000326631 future=<Future at 0x72e29c4afdd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:20.151911 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Emitting event <LifecycleEvent: 1782441965.1492193, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:20.152182 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:20.152397 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Stopped (Lifecycle Event)
Jun 26 02:46:20.158256 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.175949680999793 future=<Future at 0x72e29c230ce0 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:20.158373 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.17579957199996 future=<Future at 0x72e29c230ce0 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:20.158466 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:20.211752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:20.211752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:20.215523 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:20.215709 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Claim successful on node np0000003683
Jun 26 02:46:20.278049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:20.278049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:20.278049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:20.278049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:20.278049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:20.279184 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Terminating instance
Jun 26 02:46:20.659918 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6b0789af-1104-4f15-9862-48b8b73b553e tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:20.784561 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:46:20.816576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.824066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.845104 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.848750 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.867617 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.872004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:20.945569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 67 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:20.946003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:20.999394 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:20.999669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:20.999935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:20.999935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:21.000128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] No waiting events found dispatching network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:21.000128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5a53f83-34d0-47a5-8c3f-3e392fd3520c req-87df8f01-3eb0-40c8-97c2-ec243333ff32 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:21.121310 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99970237599996 future=<Future at 0x72e29c2bb260 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:21.121934 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99918832000003 future=<Future at 0x72e29c2bb260 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:21.121934 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999012142000083 future=<Future at 0x72e29c2bb260 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:21.122589 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Instance destroyed successfully.
Jun 26 02:46:21.123086 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'resources' on Instance uuid 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:21.475324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:21.625913 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-245535846',display_name='tempest-AttachVolumeNegativeTest-server-245535846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-245535846',id=29,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqEbFErXEXrAH9vQwVLo/SlzbfhhqBigHGt/acHrViRaM56SZ73IwTHUpv711+1UJQrx3nSMxI8KL4esc/hKMn6d2Wc2pw0SLhzymseWZG4JYiyXuFrpSWghAeS8SfEsw==',key_name='tempest-keypair-950981941',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-c97rahkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=0ad2739b-fcd9-4c33-acb7-f8fb173e1923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:21.626861 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "address": "fa:16:3e:f5:b8:6d", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape40d5f88-05", "ovs_interfaceid": "e40d5f88-0578-4142-9adc-6e1db25f2f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:21.627903 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:21.628295 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:21.629959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.630214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape40d5f88-05, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:21.632234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.632234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:21.633069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.634173 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.634340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=047a0de8-13cd-4a94-b526-4fe470e6b9cf) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:21.635004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.635741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:21.636274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.638600 np0000003683 nova-compute[98991]: INFO os_vif [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b8:6d,bridge_name='br-int',has_traffic_filtering=True,id=e40d5f88-0578-4142-9adc-6e1db25f2f91,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape40d5f88-05')
Jun 26 02:46:21.639595 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Deleting instance files /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923_del
Jun 26 02:46:21.643363 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Deletion of /opt/stack/data/nova/instances/0ad2739b-fcd9-4c33-acb7-f8fb173e1923_del complete
Jun 26 02:46:21.726196 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:21.726969 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:21.750383 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:21.778288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 330000000bcc8983d for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:21.778626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:21.778794 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000bcc8983d', 'path': '/dev/dm-5', 'multipath_id': '330000000bcc8983d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:21.778922 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bcc8983d', 'path': '/dev/dm-5', 'multipath_id': '330000000bcc8983d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:22.149053 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:46:22.149606 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:46:22.149802 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:46:22.149971 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:46:22.150262 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:22.229216 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:22.286349 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1547132050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-1547132050',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-uyj8tca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:16Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=fbf319d1-e938-4727-8ed3-2275ec9bd8c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:22.287615 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:22.288433 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:22.289562 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid fbf319d1-e938-4727-8ed3-2275ec9bd8c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:22.293346 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:22.737140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.525s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:22.737492 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:22.743134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.268s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:22.745987 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b9447965-f8ea-48b0-bbbc-c8a1063cf8ea req-d23b401d-9fcf-487e-97d4-126cbc92dc19 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-deleted-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:22.746423 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-b9447965-f8ea-48b0-bbbc-c8a1063cf8ea req-d23b401d-9fcf-487e-97d4-126cbc92dc19 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Neutron deleted interface e40d5f88-0578-4142-9adc-6e1db25f2f91; detaching it from the instance and deleting it from the info cache
Jun 26 02:46:22.747053 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_requests' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:22.747736 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b9447965-f8ea-48b0-bbbc-c8a1063cf8ea req-d23b401d-9fcf-487e-97d4-126cbc92dc19 service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Detach interface failed, port_id=e40d5f88-0578-4142-9adc-6e1db25f2f91, reason: Instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <uuid>fbf319d1-e938-4727-8ed3-2275ec9bd8c2</uuid>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <name>instance-00000024</name>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1547132050</nova:name>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:18</nova:creationTime>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         <nova:port uuid="91f954d1-a626-4f25-b4c3-6506911b864d">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="serial">fbf319d1-e938-4727-8ed3-2275ec9bd8c2</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="uuid">fbf319d1-e938-4727-8ed3-2275ec9bd8c2</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/disk.config"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <alias name="ua-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-5"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <serial>fac428e5-dfe8-4ea8-8b8c-e41d09a491b9</serial>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <shareable/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:52:a7:ac"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <target dev="tap91f954d1-a6"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/console.log" append="off"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:22.795015 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Preparing to wait for external event network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1547132050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-1547132050',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-uyj8tca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:16Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=fbf319d1-e938-4727-8ed3-2275ec9bd8c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:22.797168 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:22.797415 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:22.797728 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:22.798234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.798466 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:22.798692 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:22.799727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.799895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6aca9f7-9920-5f23-8d41-20951eb26221', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:22.800703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.801357 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:22.801770 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.803804 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.803919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f954d1-a6, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:22.804184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91f954d1-a6, col_values=(('qos', UUID('c8bd879b-3aa6-479f-aa85-c3ef8e3039a8')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:22.804335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91f954d1-a6, col_values=(('external_ids', {'iface-id': '91f954d1-a626-4f25-b4c3-6506911b864d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:a7:ac', 'vm-uuid': 'fbf319d1-e938-4727-8ed3-2275ec9bd8c2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:22.805022 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.806046 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:22.810884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:22.811565 np0000003683 nova-compute[98991]: INFO os_vif [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6')
Jun 26 02:46:23.053790 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:23.054011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] Acquiring lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:23.054199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:23.054337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:23.054489 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] No waiting events found dispatching network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:23.054633 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0dfb7dce-817b-4aff-bf7a-79ae7088acc1 req-3af4243d-fba2-4f2e-93d3-572105a7975d service nova] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Received event network-vif-unplugged-e40d5f88-0578-4142-9adc-6e1db25f2f91 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:23.194932 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:23.247177 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:23.247341 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:23.247684 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:23.247989 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:23.250996 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'numa_topology' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:23.329139 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94a20c5b3a594daaacb7bef508d1ee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b07c33d4ed466ca32fa63a7e8b74e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:23.697464 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Took 1.55 seconds to deallocate network for instance.
Jun 26 02:46:23.754717 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:23.757946 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:23.758288 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Claim successful on node np0000003683
Jun 26 02:46:23.799551 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Successfully created port: cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:24.204664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:24.258631 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:24.329510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:24.329510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:24.329510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:52:a7:ac, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:24.329510 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Using config drive
Jun 26 02:46:24.400177 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Successfully updated port: cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:24.834000 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:24.902267 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:24.902392 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:24.902573 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:24.986569 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Creating config drive at /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/disk.config
Jun 26 02:46:24.989180 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxvjq8kvh {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.041670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxvjq8kvh" returned: 0 in 0.052s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.144288 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:25.146511 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing instance network info cache due to event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:25.146511 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:25.274617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:25.277366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:25.278524 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Creating image(s)
Jun 26 02:46:25.282516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:25.282516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:25.282516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:25.282516 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:25.285618 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:25.289322 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.350032 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:25.350370 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:25.393530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.393530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:25.393530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:25.393530 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:25.394894 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:25.395387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.488662 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:25.495023 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:25.502551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.508254 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.535235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:25.580418 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk 1073741824" returned: 0 in 0.076s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.581191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:25.583030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.626503 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:25.705491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:25.705645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:25.721703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.140s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.723018 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:46:25.723281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:25.772813 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2e96e559-755b-4915-8f50-0efdd36bff86 req-6fd64f27-7647-4522-b9da-6c63827f213c service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:25.772813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2e96e559-755b-4915-8f50-0efdd36bff86 req-6fd64f27-7647-4522-b9da-6c63827f213c service nova] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:25.782579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2e96e559-755b-4915-8f50-0efdd36bff86 req-6fd64f27-7647-4522-b9da-6c63827f213c service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:25.782579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2e96e559-755b-4915-8f50-0efdd36bff86 req-6fd64f27-7647-4522-b9da-6c63827f213c service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:25.782579 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2e96e559-755b-4915-8f50-0efdd36bff86 req-6fd64f27-7647-4522-b9da-6c63827f213c service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Processing event network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:25.825534 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:25.835920 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:25.836246 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Cannot resize image /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:46:25.836603 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:25.836816 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Ensure instance console log exists: /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:25.837097 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:25.837283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:25.837424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:25.854865 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:25.911316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:25.938418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:26.005010 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:26.212709 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:26.313708 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441986.3131528, fbf319d1-e938-4727-8ed3-2275ec9bd8c2 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:26.314223 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:26.314550 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] VM Started (Lifecycle Event)
Jun 26 02:46:26.318411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:26.319283 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance spawned successfully.
Jun 26 02:46:26.319735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:26.367670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.625s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:26.369533 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:26.369533 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:26.495195 np0000003683 nova-compute[98991]: INFO nova.network.neutron [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating port 8d73365b-ab16-4a51-8329-11ab8872174f with attributes {'binding:host_id': 'np0000003683', 'device_owner': 'compute:nova'}
Jun 26 02:46:26.507376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:26.508527 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance network_info: |[{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:26.510124 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start _get_guest_xml network_info=[{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:26.510783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:26.510783 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:26.514668 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:26.515262 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1868442542', uuid='35615762-25e8-4ae1-98b8-c0dd0083e709'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441986.514224) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:26.515953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:26.517967 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:26.522468 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:26.522795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:26.525500 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:26.528700 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:26.529386 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:26.529811 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:26.530937 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:26.531403 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:26.533497 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:26.555499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868442542',display_name='tempest-ServerRescueNegativeTestJSON-server-1868442542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1868442542',id=37,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxXpYanSUxxppgp1pXTr0qK/foEs6Vexq2CEFusaauLeujVxHcSB/Hz60V9zNvS9YCHaUnUtLIyf+OPJHdoKAZfLWqHtvwi5YM/+jyGRBpbhXpEUKiyBoestMnqTVfoJw==',key_name='tempest-keypair-1387228019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-zjie408o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=35615762-25e8-4ae1-98b8-c0dd0083e709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:26.555835 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:26.556628 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:26.557230 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:26.751140 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:26.819238 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:26.821547 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:26.834737 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.834935 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.835333 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.835687 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.835935 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.836911 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:26.982799 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:26.983065 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:27.017786 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <uuid>35615762-25e8-4ae1-98b8-c0dd0083e709</uuid>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <name>instance-00000025</name>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1868442542</nova:name>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:26</nova:creationTime>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         <nova:port uuid="cd1b6c07-e35a-4adb-a942-f1637c0b96a7">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="serial">35615762-25e8-4ae1-98b8-c0dd0083e709</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="uuid">35615762-25e8-4ae1-98b8-c0dd0083e709</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:a1:c1:08"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <target dev="tapcd1b6c07-e3"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/console.log" append="off"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:27.061271 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:27.064712 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Preparing to wait for external event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:27.064712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:27.064712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:27.064712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:27.064712 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868442542',display_name='tempest-ServerRescueNegativeTestJSON-server-1868442542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1868442542',id=37,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxXpYanSUxxppgp1pXTr0qK/foEs6Vexq2CEFusaauLeujVxHcSB/Hz60V9zNvS9YCHaUnUtLIyf+OPJHdoKAZfLWqHtvwi5YM/+jyGRBpbhXpEUKiyBoestMnqTVfoJw==',key_name='tempest-keypair-1387228019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-zjie408o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=35615762-25e8-4ae1-98b8-c0dd0083e709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:27.065337 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:27.067219 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:27.067540 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d36d1cb-fefc-5a78-b85f-f6f2d0f671af', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:27.070937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.071851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:27.072227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.074806 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.074954 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd1b6c07-e3, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:27.076621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd1b6c07-e3, col_values=(('qos', UUID('c652aea1-8bd8-41ab-8e89-66d46ae822ef')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:27.076621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd1b6c07-e3, col_values=(('external_ids', {'iface-id': 'cd1b6c07-e35a-4adb-a942-f1637c0b96a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:c1:08', 'vm-uuid': '35615762-25e8-4ae1-98b8-c0dd0083e709'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:27.076621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.077691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:27.083505 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:27.083838 np0000003683 nova-compute[98991]: INFO os_vif [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3')
Jun 26 02:46:27.092113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:27.092239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:27.092357 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:27.202620 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:27.202620 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing instance network info cache due to event network-changed-8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:27.202620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] Acquiring lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:27.218706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:27.326965 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:46:27.329078 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441987.3276713, fbf319d1-e938-4727-8ed3-2275ec9bd8c2 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:27.329078 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] VM Paused (Lifecycle Event)
Jun 26 02:46:27.340421 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Took 8.62 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:27.340682 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:27.370551 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:27.486378 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:27.502875 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updated VIF entry in instance network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:27.503173 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:27.595688 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:27.831790 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:27.838803 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441987.8372343, fbf319d1-e938-4727-8ed3-2275ec9bd8c2 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:27.838803 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] VM Resumed (Lifecycle Event)
Jun 26 02:46:27.848909 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Took 16.06 seconds to build instance.
Jun 26 02:46:27.862184 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:27.863388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:27.863654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:27.863991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:27.864232 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] No waiting events found dispatching network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:27.864415 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-6cc45480-48d4-4976-839a-b56fa871659e req-fe5a59c6-d7b9-44f3-a968-1612f7e4c339 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received unexpected event network-vif-plugged-91f954d1-a626-4f25-b4c3-6506911b864d for instance with vm_state active and task_state None.
Jun 26 02:46:27.994727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.627s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:28.005342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12290d14-16bc-4a63-bb5f-c92f95bb3519 req-3c029bfa-ec40-46ee-8f5d-1c75cefe3ad7 service nova] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:28.022251 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:28.050282 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Deleted allocations for instance 0ad2739b-fcd9-4c33-acb7-f8fb173e1923
Jun 26 02:46:28.188658 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:28.340837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:28.342783 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:28.363193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.587s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:28.372935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:28.373184 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:28.373401 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Attaching volume 0079d8be-f405-41b7-b872-79d2ac2b75b8 to /dev/vdb
Jun 26 02:46:28.419972 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:28.433811 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:28.459895 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:28.511507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:28.511846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:28.521651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:28.523853 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:feec:5477', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee7:d496', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fec8:9c2', 'fe80::f42f:a9ff:fef7:8092', 'fe80::fc16:3eff:fecd:fd01', 'fe80::fc16:3eff:fe45:7bea', 'fe80::fc16:3eff:fe6c:c647', 'fe80::fc16:3eff:fe75:5f24', 'fe80::e899:83ff:fe2e:3b7b', 'fe80::fc16:3eff:fe44:31f9', 'fe80::fc16:3eff:fe57:d5a3', 'fe80::818:d3ff:fe89:5917', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537'] 
Jun 26 02:46:28.523997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:28.524124 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:28.524376 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:28.524692 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updating existing volume attachment record: 6e1b08a1-5af4-4e13-adf1-4e5b089650f7 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:28.543190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:28.606109 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:28.606278 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:28.606413 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:a1:c1:08, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:28.607109 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Using config drive
Jun 26 02:46:28.690982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:28.692152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:28.692564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] Acquired lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:28.692896 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating image(s)
Jun 26 02:46:28.693418 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Refreshing network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:28.694366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:28.694610 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:28.695408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:28.695649 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:29.062553 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ef180c2e-7f12-486a-bc05-999d78a54685 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "0ad2739b-fcd9-4c33-acb7-f8fb173e1923" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.786s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:29.115714 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:29.127322 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cbc4f091-0c51-441b-95b4-6730199b1bf8', 'attached_at': '', 'detached_at': '', 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'serial': '0079d8be-f405-41b7-b872-79d2ac2b75b8'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:46:29.135528 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:29.137990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:29.138467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:29.139031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:29.139634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:29.152917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:29.153780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:29.154347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:29.154615 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:29.155062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:29.155349 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:29.169795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:29.169795 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:29.170307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:29.170307 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8] added
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:29.183425 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:29.183783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:29.183836 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:29.183999 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8] added
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:29.186463 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:29.186746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:29.187043 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:29.187043 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:29.197515 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:29.198298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:29.199240 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:29.201581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:29.339174 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Creating config drive at /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config
Jun 26 02:46:29.345041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpixqutibb {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:29.402138 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpixqutibb" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:29.709617 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:29.903133 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updated VIF entry in instance network info cache for port 8d73365b-ab16-4a51-8329-11ab8872174f. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:29.903738 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:29.930429 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:29.962953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:29.972025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:30.086205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:30.122964 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:30.125339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:30.130822 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.134162 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.134689 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.186050 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:30.187757 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:30.203883 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:30.213640 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.224002 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8168f32e-ce64-43a2-9de8-06e84b7a68b8 req-b70212b1-1358-436d-95f4-068e7bedaa17 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:30.224575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8168f32e-ce64-43a2-9de8-06e84b7a68b8 req-b70212b1-1358-436d-95f4-068e7bedaa17 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:30.224859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8168f32e-ce64-43a2-9de8-06e84b7a68b8 req-b70212b1-1358-436d-95f4-068e7bedaa17 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:30.225059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8168f32e-ce64-43a2-9de8-06e84b7a68b8 req-b70212b1-1358-436d-95f4-068e7bedaa17 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:30.225239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8168f32e-ce64-43a2-9de8-06e84b7a68b8 req-b70212b1-1358-436d-95f4-068e7bedaa17 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Processing event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:30.225846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.230389 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.248270 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.248626 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:30.249961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.251294 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] 7701802e-eb39-4e59-b935-bd9c5434b40b was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:46:30.253632 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:46:30.254011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.part /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.272511 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.272948 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:30.300383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.40.100,3260]
Jun 26 02:46:30.300383 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:30.300383 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.316974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.330377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.50.100,3260]
Jun 26 02:46:30.330377 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:30.330377 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.349075 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:30.349870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:30.350196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:30.352886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('15', '-', '-', 0) found on session 68 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:30.353058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:30.354568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:30.382174 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 68 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:30.382174 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.386404 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:30.386659 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:30.386820 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:30.387325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:30.388325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('16', '-', '-', 0) found on session 69 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:30.388499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:30.409564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84b31c3a-930a-4e6d-89ca-54b0a9a5f635 req-244f793e-1cd4-42e1-bacb-97e9d958fdbb service nova] Releasing lock "refresh_cache-d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:30.410910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 69 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:30.411108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:30.518004 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.part /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.converted" returned: 0 in 0.262s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.538667 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.640905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088.converted --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.642070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.443s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:30.642654 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.646138 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.648380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.749264 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.750143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:30.750742 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:30.751388 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.755208 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:30.756721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.874495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.875216 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.948067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088,backing_fmt=raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk 1073741824" returned: 0 in 0.072s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:30.948639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "a6f1421a8f65fe697d4de571e5c4a58e06467088" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:30.949140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:30.995991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:30.997272 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:30.997993 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441990.997528, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:31.001508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:31.001508 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Started (Lifecycle Event)
Jun 26 02:46:31.003398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:31.010800 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance spawned successfully.
Jun 26 02:46:31.011282 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:31.053123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f1421a8f65fe697d4de571e5c4a58e06467088 --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:31.054591 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'migration_context' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:31.155500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:46:31.508369 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:31.509266 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:31.513404 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:31.526285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.526432 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.526869 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.527099 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.527345 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.527617 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:31.558504 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:31.558504 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Rebasing disk image.
Jun 26 02:46:31.558504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:31.667555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:31.669948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 -F raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:31.752972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:32.026498 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:46:32.026498 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441992.0252626, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:32.026498 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Paused (Lifecycle Event)
Jun 26 02:46:32.037902 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Took 6.76 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:32.038069 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:32.080466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:32.080827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:32.081370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:32.084274 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:32.084461 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Claim successful on node np0000003683
Jun 26 02:46:32.169122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 3300000001ceee3c1 for multipath device dm-8 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:32.169616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:32.171367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000001ceee3c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000001ceee3c1'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:32.171612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ceee3c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000001ceee3c1'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:32.173673 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:46:32.174040 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:46:32.174253 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:46:32.193872 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:46:32.193872 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:46:32.193872 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:46:32.193872 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:46:32.194939 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x72e27c27d5b0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'cbc4f091-0c51-441b-95b4-6730199b1bf8', 'attached_at': '', 'detached_at': '', 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'serial': '0079d8be-f405-41b7-b872-79d2ac2b75b8'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:46:32.194939 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] formatting encrypted volume /dev/dm-8 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:46:32.301241 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:32.301508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:32.301719 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:32.301848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:32.301979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:32.302097 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-2eeff372-8017-4501-ad07-c1e1d3a0c0e0 req-eee04c25-1610-4088-b373-a4ceeddba396 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state None.
Jun 26 02:46:32.533039 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:32.536875 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782441992.536519, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:32.537069 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Resumed (Lifecycle Event)
Jun 26 02:46:32.538720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 -F raw /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk" returned: 0 in 0.870s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:32.542551 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:32.542551 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:32.542551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:32.542551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:32.542551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:32.544673 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start _get_guest_xml network_info=[{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='9e33dbb8cc7a6186c54576754d97b28a',container_format='bare',created_at=2026-06-26T02:46:03Z,direct_url=<?>,disk_format='qcow2',id=7701802e-eb39-4e59-b935-bd9c5434b40b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-597508233-shelved',owner='8a7eadbb081143fb8f96d0187a0f7c09',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-06-26T02:46:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd698c7d4-18e4-4942-b4ee-53ab9c385069', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'd3ee0b17-0238-4c17-b36d-5cc6e0e09dcb', 'attached_at': '', 'detached_at': '', 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'serial': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:32.548057 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:32.550391 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-597508233', uuid='d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb'), owner=OwnerMeta(userid='b7340727e31547a4b39299401535770d', username='tempest-AttachVolumeShelveTestJSON-100564320-project-member', projectid='8a7eadbb081143fb8f96d0187a0f7c09', projectname='tempest-AttachVolumeShelveTestJSON-100564320'), image=ImageMeta(id='7701802e-eb39-4e59-b935-bd9c5434b40b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441992.5495465) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:32.555047 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Took 12.41 seconds to build instance.
Jun 26 02:46:32.560503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:32.560503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:32.566501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:32.566501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:32.566501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:32.566501 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9e33dbb8cc7a6186c54576754d97b28a',container_format='bare',created_at=2026-06-26T02:46:03Z,direct_url=<?>,disk_format='qcow2',id=7701802e-eb39-4e59-b935-bd9c5434b40b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-597508233-shelved',owner='8a7eadbb081143fb8f96d0187a0f7c09',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-06-26T02:46:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:32.568748 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:32.569692 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:32.570866 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:32.571203 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:32.571543 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:32.571946 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:32.573755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:32.573755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:32.573755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:32.573755 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:32.573755 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:32.586840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:32.587045 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:33.040304 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:33.043661 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:33.059077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.919s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:33.076058 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:33.090348 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:33.102303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:33.102303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:33.102303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:33.104166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:33.104166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:33.122890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:33.123281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:33.124572 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:33.124840 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:33.125788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:33.125974 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:33.139972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:33.139972 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:33.153428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:33.153428 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5] added
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:33.164700 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:33.164985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:33.165119 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:33.165261 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5] added
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:33.165946 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:33.166159 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:33.166235 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:33.166360 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:33.658733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:33.673110 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:33.673110 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:34.058659 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:34.060784 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing instance network info cache due to event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:34.061030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:34.061703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:34.061890 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:34.165886 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:34.166891 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:34.174831 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:34.182929 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:34.187863 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.204909 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.216636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.224686 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.224950 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.232273 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.232603 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:34.273889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.40.100,3260]
Jun 26 02:46:34.273889 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:34.273889 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.282081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.50.100,3260]
Jun 26 02:46:34.282081 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:34.282081 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.290058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.297151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.313334 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.313669 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:34.313953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:34.313953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:34.315209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] HCTL ('17', '-', '-', 0) found on session 70 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:34.315209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.316449 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] HCTL ('18', '-', '-', 0) found on session 71 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:34.318842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:34.337369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching for a device in session 70 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:34.337369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:34.337369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching for a device in session 71 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:34.337369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:34.564891 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:34.687831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.607s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:34.688914 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.030s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:34.690800 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:34.694307 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:34.694553 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Claim successful on node np0000003683
Jun 26 02:46:34.875795 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:34.999712 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updated VIF entry in instance network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:34.999984 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:35.125132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:46:35.200532 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:35.202837 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:35.203122 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:35.203351 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:35.292564 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:35.502037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2d9d8b8f-d3d3-4cb3-a2d8-270caf74814f req-c830a9e8-3974-4cad-9274-e675de34702b service nova] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:35.531875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:35.532093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:35.717130 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:35.723760 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Successfully created port: 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:36.036412 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:36.121465 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00048023699991972535 future=<Future at 0x72e29c2bb260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:36.121751 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:36.122143 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Emitting event <LifecycleEvent: 1782441981.1208577, 0ad2739b-fcd9-4c33-acb7-f8fb173e1923 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:36.122143 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] VM Stopped (Lifecycle Event)
Jun 26 02:46:36.140773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Found WWN 33000000029b0d7f3 for multipath device dm-9 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:36.141899 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:36.141899 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000029b0d7f3', 'path': '/dev/dm-9', 'multipath_id': '33000000029b0d7f3'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:36.141899 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029b0d7f3', 'path': '/dev/dm-9', 'multipath_id': '33000000029b0d7f3'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:36.200412 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Successfully updated port: 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:36.230145 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:36.257453 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:36.257653 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing instance network info cache due to event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:36.257780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] Acquiring lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:36.257867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] Acquired lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:36.257967 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing network info cache for port 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:36.284921 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:36.285109 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]:     <volume>0079d8be-f405-41b7-b872-79d2ac2b75b8</volume>
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:46:36.301132 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:46:36.306316 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:36.542425 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Ignoring supplied device name: /dev/vdb
Jun 26 02:46:36.625898 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-21947ccf-0e26-42bd-9ada-6f9a73789f70 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 0ad2739b-fcd9-4c33-acb7-f8fb173e1923] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:36.649034 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='7701802e-eb39-4e59-b935-bd9c5434b40b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1639916074',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:23Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:46:10.438263',shelved_host='np0000003683',shelved_image_id='7701802e-eb39-4e59-b935-bd9c5434b40b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:36.649034 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:36.649034 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:36.649034 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:36.702587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:36.755423 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:36.759793 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:36.787602 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:36.812411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Attempting to attach volume 0079d8be-f405-41b7-b872-79d2ac2b75b8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <alias name="ua-0079d8be-f405-41b7-b872-79d2ac2b75b8"/>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <serial>0079d8be-f405-41b7-b872-79d2ac2b75b8</serial>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="5a8694b3-fb22-47c7-a4c9-8890bc11aa46"/>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:36.814105 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:46:36.816574 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:36.961606 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:37.045791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.082443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <uuid>d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</uuid>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <name>instance-0000001c</name>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-597508233</nova:name>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:32</nova:creationTime>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:user uuid="b7340727e31547a4b39299401535770d">tempest-AttachVolumeShelveTestJSON-100564320-project-member</nova:user>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:project uuid="8a7eadbb081143fb8f96d0187a0f7c09">tempest-AttachVolumeShelveTestJSON-100564320</nova:project>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         <nova:port uuid="8d73365b-ab16-4a51-8329-11ab8872174f">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="serial">d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="uuid">d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <alias name="ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-9"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <target dev="vdc" bus="virtio"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <serial>0cefb5ab-dba0-478a-a0e4-8fac6972e5a5</serial>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:0b:2f:b0"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <target dev="tap8d73365b-ab"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/console.log" append="off"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Preparing to wait for external event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:37.152561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.156191 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='7701802e-eb39-4e59-b935-bd9c5434b40b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1639916074',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:23Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:46:10.438263',shelved_host='np0000003683',shelved_image_id='7701802e-eb39-4e59-b935-bd9c5434b40b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:37.156191 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:37.156191 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:37.156191 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:37.156585 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.156853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:37.157100 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:37.158698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.158698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c8d85d-5715-5253-a197-c8a81af821d6', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:37.159102 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.159817 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:37.160512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.161997 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.162998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d73365b-ab, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:37.162998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d73365b-ab, col_values=(('qos', UUID('3ff66caf-0f70-460f-a7b4-0e4a1013c649')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:37.162998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d73365b-ab, col_values=(('external_ids', {'iface-id': '8d73365b-ab16-4a51-8329-11ab8872174f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:2f:b0', 'vm-uuid': 'd3ee0b17-0238-4c17-b36d-5cc6e0e09dcb'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:37.164719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.164719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:37.169880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:37.170623 np0000003683 nova-compute[98991]: INFO os_vif [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab')
Jun 26 02:46:37.240890 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:37.242501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:37.242766 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Creating image(s)
Jun 26 02:46:37.243182 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:37.243352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:37.243819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.244424 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:37.247898 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:37.249063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:37.297099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.609s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.297623 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:37.335607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:37.336039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:37.336633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:37.337231 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:37.339796 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:37.340136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:37.426056 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:37.426586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:37.465438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4aa5fb37-29e1-4025-96c7-9d2589ed9206 req-6ba33fa4-591b-423d-b094-20f89e1231df service nova] Releasing lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:37.466252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:37.466603 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:37.485804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk 1073741824" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:37.486275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.486691 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:37.593550 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:37.594010 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:46:37.594250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:37.683920 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:37.684279 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:46:37.684948 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:37.685433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Ensure instance console log exists: /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:37.685795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:37.685995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:37.686114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:37.805660 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:37.806086 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:37.806459 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:37.806835 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:37.882307 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19a74f26e27346dc9badc9eb4476dfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94375dca8764ff8b335b461730d4cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:38.029519 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:38.172507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:38.173149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:38.173365 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Attaching volume 17293aec-1dcd-4048-a0be-43c6a61ca4a0 to /dev/vdb
Jun 26 02:46:38.194909 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:38.221614 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:38.233913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:38.260324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:38.304171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:38.304733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:38.314754 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:38.321989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:38.323583 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:feec:5477', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee7:d496', 'fe80::202f:aeff:fea4:f4c3', 'fe80::fc16:3eff:fec8:9c2', 'fe80::f42f:a9ff:fef7:8092', 'fe80::fc16:3eff:fecd:fd01', 'fe80::fc16:3eff:fe45:7bea', 'fe80::fc16:3eff:fe6c:c647', 'fe80::fc16:3eff:fe75:5f24', 'fe80::e899:83ff:fe2e:3b7b', 'fe80::fc16:3eff:fe44:31f9', 'fe80::fc16:3eff:fe57:d5a3', 'fe80::818:d3ff:fe89:5917', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fea1:c108'] 
Jun 26 02:46:38.323756 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:38.323873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:38.324114 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:38.325152 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updating existing volume attachment record: 7366cb3f-569c-41d6-ac35-8e7288cafb56 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:38.368724 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating instance_info_cache with network_info: [{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:38.390832 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Successfully created port: f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:38.695116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:38.695116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:38.695116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:38.695116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No VIF found with MAC fa:16:3e:0b:2f:b0, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:38.696393 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Using config drive
Jun 26 02:46:38.831182 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:38.871894 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:38.872629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance network_info: |[{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:38.877123 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Start _get_guest_xml network_info=[{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:38.878416 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:38.879826 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c3cca3db-6625-4bb7-b29b-0311e5fa2e22'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782441998.8793893) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:38.881310 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:38.882604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:38.884089 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:38.884310 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:38.886114 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:38.886836 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:38.888024 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:38.888676 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:38.888676 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:38.888676 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:38.906050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:38.906551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:38.906868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:38.907516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:38.907761 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:38.912773 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=38,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-qq0nxha9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=c3cca3db-6625-4bb7-b29b-0311e5fa2e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:38.913197 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:38.914031 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:38.914768 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:38.921849 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Successfully updated port: f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:38.925961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:38.927260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:38.928647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:38.928998 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:38.929911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:38.930161 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:38.944603 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:38.944603 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:38.953502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:38.953502 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0] added
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:38.966802 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:38.967762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:38.968098 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:38.968360 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0] added
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:38.968776 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:38.969011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:38.969104 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:38.969237 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:38.997081 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-changed-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:38.997752 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Refreshing instance network info cache due to event network-changed-f7030d40-0a10-4e26-9877-5cbaafb7e172. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:38.998060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] Acquiring lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:38.998253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] Acquired lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:38.998420 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Refreshing network info cache for port f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:39.198471 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'ec2_ids' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <uuid>c3cca3db-6625-4bb7-b29b-0311e5fa2e22</uuid>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <name>instance-00000026</name>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-0</nova:name>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:38</nova:creationTime>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         <nova:port uuid="9c5ef185-f2c9-4ed9-bc11-c9a503ccab27">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="serial">c3cca3db-6625-4bb7-b29b-0311e5fa2e22</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="uuid">c3cca3db-6625-4bb7-b29b-0311e5fa2e22</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.config"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:29:66:09"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <target dev="tap9c5ef185-f2"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/console.log" append="off"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:39.417589 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Preparing to wait for external event network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=38,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-qq0nxha9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=c3cca3db-6625-4bb7-b29b-0311e5fa2e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:39.424580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:39.426657 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.426657 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b5ad65d-34d7-5a30-a7f7-010f9646f7f9', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:39.427138 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:39.427410 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.428561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:39.433035 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.437164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.437164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c5ef185-f2, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:39.437164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c5ef185-f2, col_values=(('qos', UUID('deaeafcc-e466-4f48-b69e-337dfb363b6b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:39.437164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c5ef185-f2, col_values=(('external_ids', {'iface-id': '9c5ef185-f2c9-4ed9-bc11-c9a503ccab27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:66:09', 'vm-uuid': 'c3cca3db-6625-4bb7-b29b-0311e5fa2e22'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:39.437800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.440742 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:39.448027 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:39.448489 np0000003683 nova-compute[98991]: INFO os_vif [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2')
Jun 26 02:46:39.462217 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:39.462217 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:39.462217 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:39.462217 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:ec:54:77, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:39.501751 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:39.569780 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:39.703063 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:39.703063 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'keypairs' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:39.735897 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:39.844515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:39.845638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:39.845930 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Creating image(s)
Jun 26 02:46:39.846436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:39.846687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:39.847150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:39.847690 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:39.850314 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:39.851679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:39.935461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.083s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:39.936008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:39.936632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:39.937270 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:39.941852 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:39.942344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:39.969226 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:39.972754 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:39.983033 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:39.990234 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:39.995563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.003504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.017971 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.021322 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.023803 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.024215 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:40.027177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:40.027177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:40.069594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.50.100,3260]
Jun 26 02:46:40.069594 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:40.069594 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.079585 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.40.100,3260]
Jun 26 02:46:40.079585 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:40.079585 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.082380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk 1073741824" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:40.082997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:40.083354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:40.097179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.098670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.121002 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:40.121744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:40.121814 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:40.124922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] HCTL ('19', '-', '-', 0) found on session 72 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:40.125069 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.130891 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:40.132458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:40.144005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] HCTL ('20', '-', '-', 0) found on session 73 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:40.144005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:40.144005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching for a device in session 72 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:40.144005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:40.154380 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Searching for a device in session 73 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:40.154380 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:40.203589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.120s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:40.203960 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:46:40.204181 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:40.225683 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:46:40.232390 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:40.238470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a16552eb-47ae-4ca1-86cc-8f5b619ce78f req-69de8bd2-4f5b-413c-be09-12a405ef3575 service nova] Releasing lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:40.241713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquired lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:40.241713 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:40.295350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:40.296280 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Cannot resize image /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:46:40.296736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:40.297000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Ensure instance console log exists: /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:40.297303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:40.297650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:40.297817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:40.412906 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Creating config drive at /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config
Jun 26 02:46:40.418346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe19vb2x3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:40.468591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe19vb2x3" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:40.826681 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:40.927330 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:40.931816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:46:40.970684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:40.979275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:40.984360 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:40.984360 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:40.986014 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:29:66:09, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:40.986014 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Using config drive
Jun 26 02:46:41.023731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-19847dbd-aa18-4c7e-9f0e-e76a5e017e0f tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.650s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:41.053877 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:41.084688 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:41.220921 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0c0cb365-ccf1-4c53-9159-acf5b8331cb3 req-21383224-4b0d-4a43-ae99-b8d9a27fb0e5 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:41.221168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c0cb365-ccf1-4c53-9159-acf5b8331cb3 req-21383224-4b0d-4a43-ae99-b8d9a27fb0e5 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:41.221384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c0cb365-ccf1-4c53-9159-acf5b8331cb3 req-21383224-4b0d-4a43-ae99-b8d9a27fb0e5 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:41.221688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c0cb365-ccf1-4c53-9159-acf5b8331cb3 req-21383224-4b0d-4a43-ae99-b8d9a27fb0e5 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:41.221758 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0c0cb365-ccf1-4c53-9159-acf5b8331cb3 req-21383224-4b0d-4a43-ae99-b8d9a27fb0e5 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Processing event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:41.292825 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updating instance_info_cache with network_info: [{"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:41.328050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:41.526230 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:41.537569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:41.537779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:41.682726 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Creating config drive at /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.config
Jun 26 02:46:41.686930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoeyuxrs6 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:41.738169 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoeyuxrs6" returned: 0 in 0.051s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:41.758005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:41.796345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Releasing lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:41.796896 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance network_info: |[{"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:41.799708 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Start _get_guest_xml network_info=[{"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:41.803235 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:41.805243 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1746326085', uuid='f209d7e5-1a71-4b80-9b35-f05f0f860265'), owner=OwnerMeta(userid='19a74f26e27346dc9badc9eb4476dfa1', username='tempest-AttachVolumeNegativeTest-918921231-project-member', projectid='a94375dca8764ff8b335b461730d4cdb', projectname='tempest-AttachVolumeNegativeTest-918921231'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442001.804743) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:41.807186 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:41.808207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:41.809626 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:41.810025 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:41.811589 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:41.812089 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:41.812341 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:41.812570 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:41.812807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:41.812994 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:41.813245 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:41.813753 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:41.813929 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:41.814142 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:41.814255 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:41.814452 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:41.830857 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442001.8303852, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:41.831019 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Started (Lifecycle Event)
Jun 26 02:46:41.833266 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:41.837520 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1746326085',display_name='tempest-AttachVolumeNegativeTest-server-1746326085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1746326085',id=39,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+10TGcqnWDjqhSHFtJoiBawO/eBjzZG6zagpsPo+7mgAlDLUX7CydYZu/btFxr+NgAgNAexCWrmREWNlExbs6XQyP3UASjVqVGmbw1VXntsdFQaPei2rolzlWR/p4mw==',key_name='tempest-keypair-1750468069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0cpu3rv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=f209d7e5-1a71-4b80-9b35-f05f0f860265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:41.837854 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:41.840263 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:41.841671 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'pci_devices' on Instance uuid f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:41.842900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:41.849338 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance spawned successfully.
Jun 26 02:46:41.949307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found WWN 330000000a35ab479 for multipath device dm-10 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:41.950089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:41.950348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000a35ab479', 'path': '/dev/dm-10', 'multipath_id': '330000000a35ab479'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:41.950783 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a35ab479', 'path': '/dev/dm-10', 'multipath_id': '330000000a35ab479'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:41.953418 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:42.043269 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Detaching volume 0079d8be-f405-41b7-b872-79d2ac2b75b8
Jun 26 02:46:42.093614 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Attempting to driver detach volume 0079d8be-f405-41b7-b872-79d2ac2b75b8 from mountpoint /dev/vdb
Jun 26 02:46:42.134834 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'cbc4f091-0c51-441b-95b4-6730199b1bf8', 'attached_at': '', 'detached_at': '', 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'serial': '0079d8be-f405-41b7-b872-79d2ac2b75b8'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:46:42.143829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-0079d8be-f405-41b7-b872-79d2ac2b75b8 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:42.145352 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-0079d8be-f405-41b7-b872-79d2ac2b75b8 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:42.145570 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Attempting to detach device vdb from instance cbc4f091-0c51-441b-95b4-6730199b1bf8 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <alias name="ua-0079d8be-f405-41b7-b872-79d2ac2b75b8"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <serial>0079d8be-f405-41b7-b872-79d2ac2b75b8</serial>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="5a8694b3-fb22-47c7-a4c9-8890bc11aa46"/>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:42.145897 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:42.155864 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance cbc4f091-0c51-441b-95b4-6730199b1bf8 from the persistent domain config.
Jun 26 02:46:42.156083 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] (1/8): Attempting to detach device vdb with device alias ua-0079d8be-f405-41b7-b872-79d2ac2b75b8 from instance cbc4f091-0c51-441b-95b4-6730199b1bf8 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <alias name="ua-0079d8be-f405-41b7-b872-79d2ac2b75b8"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <serial>0079d8be-f405-41b7-b872-79d2ac2b75b8</serial>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="5a8694b3-fb22-47c7-a4c9-8890bc11aa46"/>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:42.156408 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:42.209680 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:42.258037 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.313949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.336960 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:42.339196 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <uuid>f209d7e5-1a71-4b80-9b35-f05f0f860265</uuid>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <name>instance-00000027</name>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1746326085</nova:name>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:41</nova:creationTime>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:user uuid="19a74f26e27346dc9badc9eb4476dfa1">tempest-AttachVolumeNegativeTest-918921231-project-member</nova:user>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:project uuid="a94375dca8764ff8b335b461730d4cdb">tempest-AttachVolumeNegativeTest-918921231</nova:project>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         <nova:port uuid="f7030d40-0a10-4e26-9877-5cbaafb7e172">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="serial">f209d7e5-1a71-4b80-9b35-f05f0f860265</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="uuid">f209d7e5-1a71-4b80-9b35-f05f0f860265</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.config"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:f5:5c:00"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <target dev="tapf7030d40-0a"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/console.log" append="off"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:42.346176 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:42.349099 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Preparing to wait for external event network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:42.349099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:42.349099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:42.349099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:42.349889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1746326085',display_name='tempest-AttachVolumeNegativeTest-server-1746326085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1746326085',id=39,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+10TGcqnWDjqhSHFtJoiBawO/eBjzZG6zagpsPo+7mgAlDLUX7CydYZu/btFxr+NgAgNAexCWrmREWNlExbs6XQyP3UASjVqVGmbw1VXntsdFQaPei2rolzlWR/p4mw==',key_name='tempest-keypair-1750468069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0cpu3rv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=f209d7e5-1a71-4b80-9b35-f05f0f860265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:42.350202 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:42.351085 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:42.351963 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:42.351963 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.352169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:42.352411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:42.354444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.354609 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ffa030b-4697-596f-9440-81ec26b45304', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:42.355994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.356109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:42.357384 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.363319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.363624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7030d40-0a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:42.364650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7030d40-0a, col_values=(('qos', UUID('94d4a2d3-eb47-4127-8570-29dab5b7358a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:42.364836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7030d40-0a, col_values=(('external_ids', {'iface-id': 'f7030d40-0a10-4e26-9877-5cbaafb7e172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5c:00', 'vm-uuid': 'f209d7e5-1a71-4b80-9b35-f05f0f860265'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:42.366058 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.367403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:42.373537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.374922 np0000003683 nova-compute[98991]: INFO os_vif [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a')
Jun 26 02:46:42.416173 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.456652 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Attempting to attach volume 17293aec-1dcd-4048-a0be-43c6a61ca4a0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:   <alias name="ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0"/>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:   <serial>17293aec-1dcd-4048-a0be-43c6a61ca4a0</serial>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:42.459851 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:46:42.473366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.478302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:42.725314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-7e28899a-6586-4b5a-a8a4-e98f948f5328 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.629s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:42.818348 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0079d8be-f405-41b7-b872-79d2ac2b75b8 for instance cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:46:42.842096 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442002.8418145, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:42.843749 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Paused (Lifecycle Event)
Jun 26 02:46:43.320109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:43.320602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:43.320833 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:43.320895 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:43.320984 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:43.321104 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received unexpected event network-vif-plugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with vm_state active and task_state None.
Jun 26 02:46:43.321209 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:43.321332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:43.321411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:43.321550 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:43.321642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Processing event network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:43.321762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:43.321856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:43.321955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:43.322049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:43.322139 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] No waiting events found dispatching network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:43.322229 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-668a9944-e07d-4258-89a5-bf333ec1bee6 req-1b4bdbe4-f74d-4581-a403-da3d67596c57 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received unexpected event network-vif-plugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 for instance with vm_state building and task_state spawning.
Jun 26 02:46:43.322463 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:43.328680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:43.330736 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance spawned successfully.
Jun 26 02:46:43.330982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:43.349698 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:43.351399 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442003.3511887, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:43.351571 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Resumed (Lifecycle Event)
Jun 26 02:46:43.839688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.839688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.839688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.839688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.840427 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.840908 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:43.853670 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:43.855336 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:43.893815 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:43.893986 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:43.894126 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:f5:5c:00, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:43.894822 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Using config drive
Jun 26 02:46:44.145497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:44.145497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:44.145497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:44.145497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No VIF found with MAC fa:16:3e:e7:d4:96, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:44.348627 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Took 7.11 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:44.348627 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:44.357705 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442004.3574398, cbc4f091-0c51-441b-95b4-6730199b1bf8 => ua-0079d8be-f405-41b7-b872-79d2ac2b75b8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:46:44.358021 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442004.3578575, c3cca3db-6625-4bb7-b29b-0311e5fa2e22 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:44.358127 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] VM Started (Lifecycle Event)
Jun 26 02:46:44.361297 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance cbc4f091-0c51-441b-95b4-6730199b1bf8 from the live domain config.
Jun 26 02:46:44.372642 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:44.372880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:44.373038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:44.373527 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:44.373906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0079d8be-f405-41b7-b872-79d2ac2b75b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:44.374070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:44.399652 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:44.412996 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '73')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:44.413433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', '68')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:44.414462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8', '69')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:44.417100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c472d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:44.417100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:44.417100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 3300000001ceee3c1 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:44.445162 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:44.510100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:44.535147 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Creating config drive at /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.config
Jun 26 02:46:44.545105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5h3yqg37 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:44.566813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:44.566813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:44.568752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:44.579471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:44.580056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:44.593131 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.618093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5h3yqg37" returned: 0 in 0.072s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:44.628901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.40.100,3260]
Jun 26 02:46:44.628901 np0000003683 nova-compute[98991]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:44.628901 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.658628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.674376 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.724523 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.50.100,3260]
Jun 26 02:46:44.724523 np0000003683 nova-compute[98991]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-0079d8be-f405-41b7-b872-79d2ac2b75b8, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:44.724523 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.744024 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:44.744998 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:44.745131 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (372ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:44.745261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:44.860294 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Took 12.84 seconds to build instance.
Jun 26 02:46:44.862543 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:44.866997 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:45.075351 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.114897 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.202605 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.316581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c733606-6c89-4a12-8710-63bb3a7852b4 req-4c76b268-3bc5-4bfd-90fe-9d0bd9b705cc service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:45.316581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c733606-6c89-4a12-8710-63bb3a7852b4 req-4c76b268-3bc5-4bfd-90fe-9d0bd9b705cc service nova] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:45.316581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c733606-6c89-4a12-8710-63bb3a7852b4 req-4c76b268-3bc5-4bfd-90fe-9d0bd9b705cc service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:45.316581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3c733606-6c89-4a12-8710-63bb3a7852b4 req-4c76b268-3bc5-4bfd-90fe-9d0bd9b705cc service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:45.316581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3c733606-6c89-4a12-8710-63bb3a7852b4 req-4c76b268-3bc5-4bfd-90fe-9d0bd9b705cc service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Processing event network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:46:45.324541 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:45.365072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.369s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:45.371601 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442005.3712904, c3cca3db-6625-4bb7-b29b-0311e5fa2e22 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:45.371807 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] VM Paused (Lifecycle Event)
Jun 26 02:46:45.470565 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.473493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.476703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.503389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:45.670461 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:45.670703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing instance network info cache due to event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:45.670924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] Acquiring lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:45.671040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] Acquired lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:45.671228 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing network info cache for port 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:45.736925 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d824cbc-dc6c-4451-9796-e990c43f4959 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.564s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:45.874462 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:45.876867 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442005.876568, c3cca3db-6625-4bb7-b29b-0311e5fa2e22 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:45.876993 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] VM Resumed (Lifecycle Event)
Jun 26 02:46:45.950672 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:46:45.953319 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:46:45.955739 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance spawned successfully.
Jun 26 02:46:45.956141 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:46:46.178095 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:46.334250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-431ad346-793d-4bcf-b06a-a0114e14e273 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.796s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:46.379738 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:46.384071 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.468267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:46:46.564112 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:46.740303 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updated VIF entry in instance network info cache for port 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:46.740755 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating instance_info_cache with network_info: [{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:46.765677 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:46.888027 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442006.8877501, f209d7e5-1a71-4b80-9b35-f05f0f860265 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:46.888211 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] VM Started (Lifecycle Event)
Jun 26 02:46:46.974340 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Took 7.13 seconds to spawn the instance on the hypervisor.
Jun 26 02:46:46.974795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:47.052903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:47.053111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:47.220676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:47.220864 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:47.221064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:47.221207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:47.221328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:47.224321 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Terminating instance
Jun 26 02:46:47.242943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-64085a6f-fd68-410c-9aa4-b13d1f5df4c2 req-6fb59523-fad8-4cb2-ab63-cd841d3222be service nova] Releasing lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:47.367059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:47.373623 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:47.373812 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:47.373948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:47.374068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:47.374449 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] No waiting events found dispatching network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:47.374598 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a6de5ff2-b55b-4f09-84bf-c1b03757b10f req-da5939c8-aef6-4b5b-8a04-05e05740635e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received unexpected event network-vif-plugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 for instance with vm_state active and task_state None.
Jun 26 02:46:47.391722 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:47.393798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:47.483645 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Took 13.89 seconds to build instance.
Jun 26 02:46:47.555509 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:47.727275 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:46:47.752225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:47.758700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:47.781864 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:47.814244 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:47.898786 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442007.8984406, f209d7e5-1a71-4b80-9b35-f05f0f860265 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:47.898931 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] VM Paused (Lifecycle Event)
Jun 26 02:46:47.987292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.398s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:48.066509 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Instance destroyed successfully.
Jun 26 02:46:48.066987 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'resources' on Instance uuid cbc4f091-0c51-441b-95b4-6730199b1bf8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:48.126085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:48.126239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:48.129086 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:46:48.129200 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Claim successful on node np0000003683
Jun 26 02:46:48.344202 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:48.344583 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:48.401425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:48.404034 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442008.4037147, f209d7e5-1a71-4b80-9b35-f05f0f860265 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:46:48.404227 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] VM Resumed (Lifecycle Event)
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1861734872',display_name='tempest-TestEncryptedCinderVolumes-server-1861734872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1861734872',id=33,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61tIYnzWeAHCeCx1WZ80Q2BjiKlbZwqrxx/d0zmGuS8dLCJwgQ8tehMkF0/URT6wsdynNZRc4rVqNJty5b2TRC+FcE4Peis5BPKJDEJjuk06j4J1giME4HhyvlL9Aluw==',key_name='tempest-keypair-1815078964',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:47Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-8yoaw3ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=cbc4f091-0c51-441b-95b4-6730199b1bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "666aadbc-06be-4326-beab-7ac3be314c7e", "address": "fa:16:3e:ec:54:77", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap666aadbc-06", "ovs_interfaceid": "666aadbc-06be-4326-beab-7ac3be314c7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap666aadbc-06, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.577287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:48.578965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.580200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.580200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cec65dc-674a-481b-9d1d-1474d6d0199c) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:48.580680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.581250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:48.582181 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:48.585549 np0000003683 nova-compute[98991]: INFO os_vif [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:54:77,bridge_name='br-int',has_traffic_filtering=True,id=666aadbc-06be-4326-beab-7ac3be314c7e,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666aadbc-06')
Jun 26 02:46:48.585731 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Deleting instance files /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8_del
Jun 26 02:46:48.586735 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Deletion of /opt/stack/data/nova/instances/cbc4f091-0c51-441b-95b4-6730199b1bf8_del complete
Jun 26 02:46:48.849299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:48.866408 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-changed-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:48.867028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Refreshing instance network info cache due to event network-changed-f7030d40-0a10-4e26-9877-5cbaafb7e172. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:48.867320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] Acquiring lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:48.867494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] Acquired lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:48.867625 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Refreshing network info cache for port f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:48.906758 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:46:48.908368 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:46:49.094694 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:46:49.095418 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:46:49.095771 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:46:49.095918 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:46:49.096130 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:49.166110 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:49.369647 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:49.412575 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999608481999985 future=<Future at 0x72e29c308b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:49.412575 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999113350000016 future=<Future at 0x72e29c308b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:49.412575 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998909340999944 future=<Future at 0x72e29c308b90 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:49.476734 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:49.476924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:49.478195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:49.478393 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:49.478618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] No waiting events found dispatching network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:49.478796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:49.478949 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:49.479131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Acquiring lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:49.479313 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:49.479710 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:49.479861 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] No waiting events found dispatching network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:49.480011 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671135a4-2a4c-40ba-b3c1-1b9d069dc04d req-c3162286-5b6e-4ebc-b80d-f1a6e13f67f2 service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-unplugged-666aadbc-06be-4326-beab-7ac3be314c7e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:49.841554 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:49.928798 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:49.929033 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:50.022707 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updated VIF entry in instance network info cache for port f7030d40-0a10-4e26-9877-5cbaafb7e172. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:46:50.023064 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updating instance_info_cache with network_info: [{"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:50.350299 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:50.432118 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:50.525329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-354295cc-4252-4f31-9291-4a1c3c4441e1 req-c44a70b0-abf4-4db7-b477-ee110a380aa4 service nova] Releasing lock "refresh_cache-f209d7e5-1a71-4b80-9b35-f05f0f860265" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:50.853404 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Took 1.76 seconds to deallocate network for instance.
Jun 26 02:46:50.867029 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:50.867240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:50.867485 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:50.867671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:50.867863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:50.870506 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Terminating instance
Jun 26 02:46:50.940802 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.814s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:50.941308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.092s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:50.941560 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:46:50.943704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:50.943893 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:46:51.360491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.360628 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:51.374585 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:46:51.404052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.409934 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.437802 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.449081 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:46:51.449253 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:46:51.449543 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:51.449777 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:51.471974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.482448 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.550539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.565928 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.609024 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f3b2797-284a-47d8-960e-e1300d596592 req-cc0420ff-d624-4b3a-9a92-81e0bdf09eab service nova] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Received event network-vif-deleted-666aadbc-06be-4326-beab-7ac3be314c7e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:51.657740 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:46:51.661527 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:51.661805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.666728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:51.666728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:51.666728 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:51.666728 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-39771d05-db75-42d8-8d96-6c2b0ffcc8fb req-f8c19940-b16b-4833-9aa5-b6b4964d1a50 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:51.666728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.682120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.682120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:51.710123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.751098 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.803424 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.814161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:51.814624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.814882 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:51.814987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:51.815100 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:51.815262 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d21e5e2a-ad2f-4cf4-8ed0-0de085bcc0b3 req-1a2b2e20-11fc-4745-84e1-97cc39f26767 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:51.825178 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.859129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:51.859129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:51.859129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:51.859307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:51.859434 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:51.859601 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6c2b4b21-f0df-448c-97b2-6d878e49c69e req-a297ade3-0434-4b8a-a62e-cda82b19d72d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:51.953627 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:46:51.962540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.998510 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:51.998692 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:46:52.001258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.061355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.106864 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999588885000094 future=<Future at 0x72e29c3d38c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:52.112972 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Instance destroyed successfully.
Jun 26 02:46:52.115911 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lazy-loading 'resources' on Instance uuid 00f46ba2-9383-40fb-af68-61fe8d692c6d {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:52.190172 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Detaching volume 17293aec-1dcd-4048-a0be-43c6a61ca4a0
Jun 26 02:46:52.199082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.199082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.289440 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Attempting to driver detach volume 17293aec-1dcd-4048-a0be-43c6a61ca4a0 from mountpoint /dev/vdb
Jun 26 02:46:52.299801 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found disk vdb by alias ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:52.301865 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Found disk vdb by alias ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:46:52.302012 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Attempting to detach device vdb from instance a39d0d03-58af-46e4-b549-78cf284446c0 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <alias name="ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0"/>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <serial>17293aec-1dcd-4048-a0be-43c6a61ca4a0</serial>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:52.302269 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:52.314679 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully detached device vdb from instance a39d0d03-58af-46e4-b549-78cf284446c0 from the persistent domain config.
Jun 26 02:46:52.314882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] (1/8): Attempting to detach device vdb with device alias ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0 from instance a39d0d03-58af-46e4-b549-78cf284446c0 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <alias name="ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0"/>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <serial>17293aec-1dcd-4048-a0be-43c6a61ca4a0</serial>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:46:52.315742 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:46:52.319987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.325830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.364271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:52.364573 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:52.440682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.441401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.461502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:46:52.545723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.546586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.621052 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.621710 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4c428988-ac19-4dba-8540-640346338513", "address": "fa:16:3e:c8:09:c2", "network": {"id": "0e98139f-d777-4221-8fd1-75225ea1a837", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1722096001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c428988-ac", "ovs_interfaceid": "4c428988-ac19-4dba-8540-640346338513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.622728 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.623062 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.626294 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.626803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c428988-ac, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.631016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.651256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.653737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.665306 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.669271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.669621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c69ff4e-c674-43bf-a8c7-dd7aff0ca364) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.671507 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.702447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.711717 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:09:c2,bridge_name='br-int',has_traffic_filtering=True,id=4c428988-ac19-4dba-8540-640346338513,network=Network(0e98139f-d777-4221-8fd1-75225ea1a837),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c428988-ac')
Jun 26 02:46:52.713071 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.713457 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "address": "fa:16:3e:cd:fd:01", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e40ad4-f9", "ovs_interfaceid": "a0e40ad4-f92c-40c3-a556-f8e40b33f4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.715369 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.715369 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.717043 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.717043 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e40ad4-f9, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.720491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.721245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.743667 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.744987 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.745189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=559b6b8b-177d-4cfc-81d4-1017ac457ae2) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.745739 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.746236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.748612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.755136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.780271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.785364 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=a0e40ad4-f92c-40c3-a556-f8e40b33f4ea,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0e40ad4-f9')
Jun 26 02:46:52.791551 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Successfully created port: cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:46:52.796560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.796802 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "address": "fa:16:3e:45:7b:ea", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a6c9-6d", "ovs_interfaceid": "4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.797920 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.798248 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.803358 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.803905 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d85a6c9-6d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.806013 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.807315 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.829119 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.833683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.833925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b1632bc-ef7d-4775-9f85-872daf32180a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.834626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.835216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.858132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.860145 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d85a6c9-6d')
Jun 26 02:46:52.861069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.861292 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "address": "fa:16:3e:6c:c6:47", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7c33687-ea", "ovs_interfaceid": "c7c33687-ea16-4c3a-a1cf-e5ab51039f82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.862002 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.862420 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.863406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.863756 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7c33687-ea, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.865531 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.866273 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.869704 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:52.877365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.878102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:52.893359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.898775 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.902296 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442012.8996599, a39d0d03-58af-46e4-b549-78cf284446c0 => ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:46:52.904490 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-17293aec-1dcd-4048-a0be-43c6a61ca4a0 for instance a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:46:52.904959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccdd8386-3377-4aa9-9072-96546bbe726f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.906196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.906792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.914906 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully detached device vdb from instance a39d0d03-58af-46e4-b549-78cf284446c0 from the live domain config.
Jun 26 02:46:52.916160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:52.917109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:52.917303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:52.918402 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:52.918982 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:52.919206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:52.923799 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.927108 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:47,bridge_name='br-int',has_traffic_filtering=True,id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7c33687-ea')
Jun 26 02:46:52.928259 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.928520 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "address": "fa:16:3e:75:5f:24", "network": {"id": "c2f2f669-adbb-42c3-a437-910d0eefbb09", "bridge": "br-int", "label": "tempest-device-tagging-net1-1949511887", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb4121-75", "ovs_interfaceid": "58eb4121-75dd-45b6-a7bd-34b53605d00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.929458 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.929826 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.932307 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.932991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58eb4121-75, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.934975 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.945770 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.946962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.949871 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a27a129d-0cb9-4335-9029-1387b31f7962) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.950647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.951342 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:52.960049 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0 (non-flash)
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:52.960441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '73')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:52.960776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '73')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:52.961650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', '72')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:52.962174 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.963750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4a5b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'): ({'sdn'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:52.964015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Removing multipathed devices sdn, sdo {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:52.964277 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Flush multipath device 330000000a35ab479 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:52.964890 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5f:24,bridge_name='br-int',has_traffic_filtering=True,id=58eb4121-75dd-45b6-a7bd-34b53605d00d,network=Network(c2f2f669-adbb-42c3-a437-910d0eefbb09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb4121-75')
Jun 26 02:46:52.965544 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:52.965839 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "address": "fa:16:3e:44:31:f9", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55cc07d-ec", "ovs_interfaceid": "f55cc07d-ec85-458d-a717-ae68d3c27ab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:52.966327 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:52.966579 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:52.967569 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.967950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf55cc07d-ec, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.979050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.981378 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:52.981781 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.985966 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:52.986176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2056608a-e18e-48b7-b1f6-32e89f702fcc) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:52.988738 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:46:52.988987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:46:52.989137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:46:52.990532 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:52.992047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.004470 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.007512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.009469 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=f55cc07d-ec85-458d-a717-ae68d3c27ab8,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55cc07d-ec')
Jun 26 02:46:53.010901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1258360344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-device-tagging-server-1258360344',id=32,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuneXJPUQIORw5aLlgaKwSWEGNTQpV+5F159VzOoJUm/KUcEzNp6Z0nd6Ra59jQNp5HXPUrgrqRxrCRCDcpwf8zKCdfOyS8pVhiodN5+JgtYlLfPrcrkQc8rJ9hlUZzxQ==',key_name='tempest-keypair-100382279',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e8df8f519e47eeba096968739cfd68',ramdisk_id='',reservation_id='r-a5tice0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-285870187',owner_user_name='tempest-TaggedBootDevicesTest_v242-285870187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ba91ef3eaa94fcf8f4627a6d0d37c10',uuid=00f46ba2-9383-40fb-af68-61fe8d692c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:53.011259 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converting VIF {"id": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "address": "fa:16:3e:57:d5:a3", "network": {"id": "463ab16a-1124-46ca-ba44-f2b77172c5fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-493281347", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "09e8df8f519e47eeba096968739cfd68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f2b92b-e7", "ovs_interfaceid": "92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:53.012523 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:53.013419 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:53.016434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.016872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92f2b92b-e7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:53.018790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.019915 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:53.020400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.022105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.022443 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc0c7b76-2e12-4c0a-b08e-299bac796f31) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:53.023883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.024594 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:53.026052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:53.029519 np0000003683 nova-compute[98991]: INFO os_vif [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7,network=Network(463ab16a-1124-46ca-ba44-f2b77172c5fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f2b92b-e7')
Jun 26 02:46:53.035870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:53.036384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:53.036711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:53.052066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.090050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.090421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.109777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:53.110016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:53.111782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:53.122690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:53.123071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:53.134716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.175977 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.40.100,3260]
Jun 26 02:46:53.175977 np0000003683 nova-compute[98991]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:53.175977 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.187520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.191986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.204793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.218004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.258105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.50.100,3260]
Jun 26 02:46:53.258105 np0000003683 nova-compute[98991]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:53.258105 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.281329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.281906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:53.282100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== disconnect_volume: return (364ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:53.282303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:53.289193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.252s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:53.289893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:53.290159 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:53.298702 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.303564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.351099 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.351591 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:53.351897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:53.352010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '58')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:53.354140 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c', '59')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:53.356102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c578540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:53.356371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:53.356672 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Flush multipath device 330000000eb7b691d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:53.380752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.019s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.422054 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.422378 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:46:53.426675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.443998 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.456917 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Successfully updated port: cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:46:53.463041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.463353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.487121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:46:53.490341 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:46:53.491445 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Creating image(s)
Jun 26 02:46:53.492007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.492184 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.492723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.493318 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:53.496036 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:53.498489 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deleted allocations for instance cbc4f091-0c51-441b-95b4-6730199b1bf8
Jun 26 02:46:53.500814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.519591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.525878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.526572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.566265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:53.566558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:53.568028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:53.579263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:53.579579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:53.590849 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.591494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.592330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.592774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.593447 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:53.596352 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:46:53.596835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.612943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.625847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.642591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.40.100,3260]
Jun 26 02:46:53.642591 np0000003683 nova-compute[98991]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:53.642591 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.665970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.678634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.689587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.689803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.690448 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.690561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.690728 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.690865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.691010 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.691272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.691461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.691606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.691759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.692085 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-a0e40ad4-f92c-40c3-a556-f8e40b33f4ea for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.692085 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.692398 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.692604 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.692748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.692891 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.693032 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.693168 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.693382 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.693496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.693638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.693766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.693892 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5c71af00-d681-499f-99f2-b4832d1fd8b0 req-c4edbc1d-aabc-4e18-adc6-e224725467b0 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4d85a6c9-6d5e-492a-b84b-ec6f90fd4f38 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.699372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.699939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.720902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.50.100,3260]
Jun 26 02:46:53.720902 np0000003683 nova-compute[98991]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-b445d202-d2f5-44ff-8efc-5cb55da9ea0c, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:53.720902 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.721858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.722766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.738062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.739807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:53.740073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== disconnect_volume: return (703ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:53.746574 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:53.748194 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.749239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.751739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.751904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.752081 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.752526 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-00293b46-c0f0-4579-979f-ec012b9836d7 req-8496fc8a-d21c-4256-b874-d80d056a20cf service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-4c428988-ac19-4dba-8540-640346338513 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.753830 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:53.754334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:53.754546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:53.755026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:53.755353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '375eb09e-23f6-4946-983f-f6c7ca89d076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:53.755545 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:53.773795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk 1073741824" returned: 0 in 0.074s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.774231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.774697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.788624 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:53.789073 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:53.789379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:53.789612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '60')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:53.792752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076', '61')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:53.793334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e730ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:53.793808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:53.794110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Flush multipath device 330000000f72e0a58 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:53.827043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.838920 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.843079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.862194 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'flavor' on Instance uuid a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:53.879815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:53.891151 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.116s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.891678 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:46:53.891970 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.930898 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.930898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.930898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.930898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.933369 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.934970 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.935857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.936364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.936681 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.937263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:53.937510 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.937869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.938055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.938734 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:53.939021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.940217 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:53.940454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.940766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.952812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:53.955266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.956450 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.957669 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-58eb4121-75dd-45b6-a7bd-34b53605d00d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.958058 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.958384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.959021 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.959398 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.959820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.960065 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.960249 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.960671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.960881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.961061 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.961279 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.961576 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-f55cc07d-ec85-458d-a717-ae68d3c27ab8 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.961753 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.961978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.962199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:53.962504 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing instance network info cache due to event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:46:53.962780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Acquiring lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.963054 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Acquiring lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:53.963284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.963506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Acquired lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:53.963783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:53.964350 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing network info cache for port cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:46:53.967280 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] No waiting events found dispatching network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:53.968564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:53.969144 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d7a6efde-ba8d-48d3-b79a-cb86d58b876b req-e5048088-4da7-4339-9bd7-c32e4525949d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-unplugged-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:53.971338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:53.972034 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:46:53.975875 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:53.986319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:53.995576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:53.996379 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:46:53.996887 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:46:53.997120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Ensure instance console log exists: /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:46:53.997492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:53.997744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:53.997898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:54.030458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.40.100,3260]
Jun 26 02:46:54.030458 np0000003683 nova-compute[98991]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:54.030458 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.031647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:54.039521 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:54.040555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:54.061568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.074191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.091140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:54.091609 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=48937MB free_disk=73.58480072021484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:46:54.091798 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:54.092451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:54.108700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.50.100,3260]
Jun 26 02:46:54.108700 np0000003683 nova-compute[98991]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-375eb09e-23f6-4946-983f-f6c7ca89d076, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:54.108700 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.126289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.126687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:54.126853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== disconnect_volume: return (372ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:54.127127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:54.130123 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:54.130545 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:54.130671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:54.131103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:54.131442 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ec19119-f855-41bf-a3dc-452f25bc62c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:54.131623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:54.163068 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsi session list stdout=tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:54.163403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '62')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:54.164355 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7', '63')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:54.165154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c2e1bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:54.165396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:46:54.165667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Flush multipath device 330000000ee73d5f9 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:46:54.202107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:54.260084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:46:54.317098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:46:54.317252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:46:54.318198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:46:54.329719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:46:54.329965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:54.344828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.374149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.40.100,3260]
Jun 26 02:46:54.374149 np0000003683 nova-compute[98991]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:54.374149 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.393009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.409062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.447720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.50.100,3260]
Jun 26 02:46:54.447720 np0000003683 nova-compute[98991]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-0ec19119-f855-41bf-a3dc-452f25bc62c7, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:54.447720 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.466314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:54.466466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:54.466635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] <== disconnect_volume: return (335ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:54.466757 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:54.467051 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Deleting instance files /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d_del
Jun 26 02:46:54.467600 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Deletion of /opt/stack/data/nova/instances/00f46ba2-9383-40fb-af68-61fe8d692c6d_del complete
Jun 26 02:46:54.470919 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:54.524030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-67e4cd0d-21db-4a8e-b7d5-999bb5f1ed9b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "cbc4f091-0c51-441b-95b4-6730199b1bf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.302s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:54.533753 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:54.702000 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:54.872806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e93da26c-6c0d-4773-a97c-0cd44ec2326b tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.191s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:54.873605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.122s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:54.874371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:54.874621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:54.874769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:54.881728 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Terminating instance
Jun 26 02:46:54.976768 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Took 3.60 seconds to destroy the instance on the hypervisor.
Jun 26 02:46:54.977472 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:46:54.977905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:46:54.978033 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:46:54.978298 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:54.982213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:55.163643 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 121ec5e6-08cf-4e0c-9c89-e2be23a274be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.163985 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 266d20a5-b882-4896-9d47-a60855b80312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.163985 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 00f46ba2-9383-40fb-af68-61fe8d692c6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.163985 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a39d0d03-58af-46e4-b549-78cf284446c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.164187 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.164187 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.164290 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.164332 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 35615762-25e8-4ae1-98b8-c0dd0083e709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.164660 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.165051 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance f209d7e5-1a71-4b80-9b35-f05f0f860265 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.165133 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 438d9a42-bd81-4489-8c87-68f146dfc61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:46:55.165720 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 11 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:46:55.165720 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2624MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:46:54 up 33 min,  2 users,  load average: 8.44, 6.49, 3.54\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '11', 'num_proj_d2b07c33d4ed466ca32fa63a7e8b74e4': '3', 'io_workload': '1', 'num_vm_rescued': '1', 'num_task_deleting': '2', 'num_proj_09e8df8f519e47eeba096968739cfd68': '1', 'num_proj_bac7218fd5ea43579f052f1bd83fe39b': '1', 'num_proj_f149d284f0d24070afe71cccd4c0c744': '1', 'num_proj_f2b74afe940c40d490cd930d9056fc92': '3', 'num_proj_a94375dca8764ff8b335b461730d4cdb': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_8a7eadbb081143fb8f96d0187a0f7c09': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:46:55.169933 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:55.207055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d94e23e-af46-4745-9e67-15497d8b9562 req-aa02cb6e-2429-4cf2-ad27-ed953381d69d service nova] Releasing lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:55.208765 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:46:55.208953 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:46:55.386242 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:46:55.415598 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.428156 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.444725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.446331 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.490361 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.691564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.698891 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:55.726553 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999702607000017 future=<Future at 0x72e27c207950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:46:55.729797 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Instance destroyed successfully.
Jun 26 02:46:55.732121 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lazy-loading 'resources' on Instance uuid a39d0d03-58af-46e4-b549-78cf284446c0 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:55.756133 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:55.756330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:55.756595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:55.756781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:55.756988 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] No waiting events found dispatching network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:55.757129 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-80df0371-1196-461b-92a0-c6102b0a9603 req-51044723-7a79-4044-900a-f645962e81b1 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:55.825013 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:46:56.015142 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:56.015454 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:56.074597 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:56.089447 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:56.089742 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:56.090000 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attaching volume fa95d91b-f70b-4c4d-aea3-ed734f221555 to /dev/vdb
Jun 26 02:46:56.138715 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:56.148949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:46:56.181174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:56.239037 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1099058061',display_name='tempest-VolumesSnapshotTestJSON-instance-1099058061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumessnapshottestjson-instance-1099058061',id=34,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkuKPz2JhFRBFZqwidObB/jupuUT1tBeKYpGMVqCC7WHru7TQSPXthuPmO2yBnhiapOgc2VY4UHKdkWrV2kpY7hnavbL7YTa+n2PqpxCxRf2phNxkrhB04yC7y4W+MFog==',key_name='tempest-keypair-1320854438',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:58Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bac7218fd5ea43579f052f1bd83fe39b',ramdisk_id='',reservation_id='r-953osuu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-670786988',owner_user_name='tempest-VolumesSnapshotTestJSON-670786988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a90f9b496904250a9167c7761ad6f7b',uuid=a39d0d03-58af-46e4-b549-78cf284446c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:46:56.239736 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converting VIF {"id": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "address": "fa:16:3e:e7:d4:96", "network": {"id": "8826bcfa-e01d-429a-ac50-da3c0965a469", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-737618707-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bac7218fd5ea43579f052f1bd83fe39b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92fe4ccc-62", "ovs_interfaceid": "92fe4ccc-62d5-475f-b0f5-74afdb1321fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:56.244324 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:56.244324 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:46:56.244324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:46:56.244324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:46:56.246064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:56.246064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92fe4ccc-62, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:56.251647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:56.252588 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:56.252800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdb4efb0-3871-4f65-a757-a839257f5155) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:56.253561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:56.254199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:56.254849 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:56.255639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:46:56.257044 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0'] 
Jun 26 02:46:56.257167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:46:56.257261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:46:56.257451 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:56.257741 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating existing volume attachment record: 897e305d-fd02-479e-b320-4775364731d3 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:46:56.265767 np0000003683 nova-compute[98991]: INFO os_vif [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=92fe4ccc-62d5-475f-b0f5-74afdb1321fe,network=Network(8826bcfa-e01d-429a-ac50-da3c0965a469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92fe4ccc-62')
Jun 26 02:46:56.270314 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:46:56.270864 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:56.271175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:56.272016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:56.272536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17293aec-1dcd-4048-a0be-43c6a61ca4a0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:46:56.272695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:46:56.278100 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating instance_info_cache with network_info: [{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:56.305580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:56.305580 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:56.305580 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:56.305580 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:56.305580 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:56.306099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:56.306099 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:56.306099 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:56.306099 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:56.306099 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:56.306303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:46:56.306528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:56.306717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:46:56.306886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:46:56.306938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17293aec-1dcd-4048-a0be-43c6a61ca4a0') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:46:56.307060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c2e0860>, {}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:46:56.307176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Disconnecting from: [] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:46:56.307390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:56.307528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] <== disconnect_volume: return (36ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:56.307655 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:46:56.307941 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Deleting instance files /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0_del
Jun 26 02:46:56.308698 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Deletion of /opt/stack/data/nova/instances/a39d0d03-58af-46e4-b549-78cf284446c0_del complete
Jun 26 02:46:56.518862 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:46:56.780983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:46:56.781815 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance network_info: |[{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:46:56.783518 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Start _get_guest_xml network_info=[{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:46:56.787120 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:46:56.788674 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='438d9a42-bd81-4489-8c87-68f146dfc61b'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442016.7882085) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:46:56.790193 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:46:56.790700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:46:56.791891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:46:56.792153 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:46:56.793638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:46:56.794160 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:46:56.794390 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:46:56.794746 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:46:56.794831 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:46:56.795026 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:46:56.795219 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:46:56.795706 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:46:56.795868 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:46:56.796228 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:46:56.796228 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:46:56.796350 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:46:56.821016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=40,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-vyaxwdko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=438d9a42-bd81-4489-8c87-68f146dfc61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:46:56.821016 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:56.821016 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:56.821016 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:56.822300 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 26 02:46:56.823332 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:46:56.825796 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:46:56.825796 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:46:56.825796 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:56.854669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:46:56.855507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:46:56.855709 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:56.856182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:56.856546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:46:56.875984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:56.876750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:56.876959 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:56.877571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:46:56.878262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:46:56.878521 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:56.893908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:56.893908 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:56.901763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:46:56.901763 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555] added
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:56.917985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:56.921755 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0443(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:56.924243 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555] added
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:46:56.925506 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:56.925760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:46:56.926105 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0474(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:46:56.926267 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:46:56.928043 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f662aebe-f24a-4003-9781-d06f2ad6a2b9 req-37bac782-c39e-4292-a6f7-3bd7d2abde8d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-deleted-4c428988-ac19-4dba-8540-640346338513 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:56.928976 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:56.929274 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-f662aebe-f24a-4003-9781-d06f2ad6a2b9 req-37bac782-c39e-4292-a6f7-3bd7d2abde8d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Neutron deleted interface 4c428988-ac19-4dba-8540-640346338513; detaching it from the instance and deleting it from the info cache
Jun 26 02:46:56.933422 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f662aebe-f24a-4003-9781-d06f2ad6a2b9 req-37bac782-c39e-4292-a6f7-3bd7d2abde8d service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Detach interface failed, port_id=4c428988-ac19-4dba-8540-640346338513, reason: Instance 00f46ba2-9383-40fb-af68-61fe8d692c6d could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:46:56.943932 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:57.027874 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:46:57.027874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.936s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:57.028641 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:46:57.197532 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-154310d8-c064-4b5e-b1de-732654f66780 req-4b15f229-2e63-4db2-8f7c-e4dc689c076a service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-deleted-c7c33687-ea16-4c3a-a1cf-e5ab51039f82 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:57.197782 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-154310d8-c064-4b5e-b1de-732654f66780 req-4b15f229-2e63-4db2-8f7c-e4dc689c076a service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Neutron deleted interface c7c33687-ea16-4c3a-a1cf-e5ab51039f82; detaching it from the instance and deleting it from the info cache
Jun 26 02:46:57.199955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-154310d8-c064-4b5e-b1de-732654f66780 req-4b15f229-2e63-4db2-8f7c-e4dc689c076a service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Detach interface failed, port_id=c7c33687-ea16-4c3a-a1cf-e5ab51039f82, reason: Instance 00f46ba2-9383-40fb-af68-61fe8d692c6d could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <uuid>438d9a42-bd81-4489-8c87-68f146dfc61b</uuid>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <name>instance-00000028</name>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-1</nova:name>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:46:56</nova:creationTime>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         <nova:port uuid="cb535a56-d9b1-4193-bbaf-14a54d385198">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="serial">438d9a42-bd81-4489-8c87-68f146dfc61b</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="uuid">438d9a42-bd81-4489-8c87-68f146dfc61b</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.config"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:2f:6b:c0"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <target dev="tapcb535a56-d9"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/console.log" append="off"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:46:57.317952 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Preparing to wait for external event network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=40,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-vyaxwdko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=438d9a42-bd81-4489-8c87-68f146dfc61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:46:57.321218 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:46:57.322965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.322965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:57.322965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:46:57.324186 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.324186 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4b28a00-e409-55c4-943e-e1c5e6fb730f', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:57.324841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.325721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:57.328711 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.330059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb535a56-d9, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:57.330059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb535a56-d9, col_values=(('qos', UUID('ad42fb29-9f8e-4f45-9461-436549426f36')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:57.330059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb535a56-d9, col_values=(('external_ids', {'iface-id': 'cb535a56-d9b1-4193-bbaf-14a54d385198', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:6b:c0', 'vm-uuid': '438d9a42-bd81-4489-8c87-68f146dfc61b'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:46:57.331720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.332193 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:46:57.337439 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:57.338974 np0000003683 nova-compute[98991]: INFO os_vif [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9')
Jun 26 02:46:57.713232 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18a0a5da-50d8-40e3-98fc-6f0d1c357058 req-6de2ff5b-3f03-4c6f-8e3b-2730710d58cd service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-deleted-f55cc07d-ec85-458d-a717-ae68d3c27ab8 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:57.716851 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-18a0a5da-50d8-40e3-98fc-6f0d1c357058 req-6de2ff5b-3f03-4c6f-8e3b-2730710d58cd service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Neutron deleted interface f55cc07d-ec85-458d-a717-ae68d3c27ab8; detaching it from the instance and deleting it from the info cache
Jun 26 02:46:57.718887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18a0a5da-50d8-40e3-98fc-6f0d1c357058 req-6de2ff5b-3f03-4c6f-8e3b-2730710d58cd service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Detach interface failed, port_id=f55cc07d-ec85-458d-a717-ae68d3c27ab8, reason: Instance 00f46ba2-9383-40fb-af68-61fe8d692c6d could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:46:57.822146 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:57.822462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] Acquiring lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:57.822898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:57.823668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] Lock "a39d0d03-58af-46e4-b549-78cf284446c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:46:57.823825 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] No waiting events found dispatching network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:46:57.823983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d3c245d-ae82-4222-ab13-4f6df7cda2ab req-2520dc24-f68f-46f0-83e0-7072965860dc service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-unplugged-92fe4ccc-62d5-475f-b0f5-74afdb1321fe for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:46:57.924934 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:46:57.926462 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:57.927421 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:57.939171 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:46:57.945344 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:57.954929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:57.962002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:57.970684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.970684 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.970684 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.970684 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.970684 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:57.970872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.970872 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.970872 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.970872 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.970872 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:57.978245 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.978245 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.978245 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.978245 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.978245 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:57.978460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.978460 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:57.978460 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.978460 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:57.978460 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:58.007752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.40.100,3260]
Jun 26 02:46:58.007752 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.40.100,3260] successful.
Jun 26 02:46:58.007752 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:58.023800 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:58.024845 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.025287 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.025589 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.025839 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.026064 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.026257 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:46:58.026388 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:46:58.026635 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.32 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:46:58.034056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.50.100,3260]
Jun 26 02:46:58.034056 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.50.100,3260] successful.
Jun 26 02:46:58.034056 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.043393 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.043737 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:58.043920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:58.045624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:58.046400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('7', '-', '-', 0) found on session 74 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:58.046579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:58.052333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:46:58.061512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 74 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:58.061645 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.072160 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:46:58.072449 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:46:58.072655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:58.072655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:46:58.073192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('8', '-', '-', 0) found on session 75 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:46:58.073295 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:46:58.095649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 75 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:46:58.095649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:46:58.430761 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Took 1.61 seconds to deallocate network for instance.
Jun 26 02:46:58.435355 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:46:58.447732 np0000003683 nova-compute[98991]: WARNING nova.volume.cinder [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Attachment 7366cb3f-569c-41d6-ac35-8e7288cafb56 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7366cb3f-569c-41d6-ac35-8e7288cafb56. (HTTP 404) (Request-ID: req-7275632f-b321-4837-9f26-57adc6431632)
Jun 26 02:46:58.448023 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Took 0.02 seconds to detach 1 volumes for instance.
Jun 26 02:46:58.673984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:58.674183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:58.856163 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:58.856761 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:46:58.856761 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:2f:6b:c0, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:46:58.856895 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Using config drive
Jun 26 02:46:58.878844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:46:58.937648 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Took 3.96 seconds to deallocate network for instance.
Jun 26 02:46:58.954735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:58.955247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:58.982723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-55802ef6-0eae-4148-93a9-5fe9236817f1 req-07e5ac44-2557-429e-9bf2-26ea4cda1013 service nova] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Received event network-vif-deleted-92fe4ccc-62d5-475f-b0f5-74afdb1321fe {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:58.982823 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-55802ef6-0eae-4148-93a9-5fe9236817f1 req-07e5ac44-2557-429e-9bf2-26ea4cda1013 service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-deleted-58eb4121-75dd-45b6-a7bd-34b53605d00d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:59.176206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:46:59.275570 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7b86322f-8246-464f-b782-7a01097395c9 req-0af2301a-3f34-4613-8c1c-085a0906217c service nova] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Received event network-vif-deleted-92f2b92b-e7f1-48b2-8f73-5bcd0a58e0c7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:46:59.362668 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:46:59.496273 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Creating config drive at /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.config
Jun 26 02:46:59.500463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmply9jih1v {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:46:59.559308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmply9jih1v" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:46:59.593282 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:46:59.593742 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:46:59.727295 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:59.894739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found WWN 330000000e5bfe0f2 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:46:59.895896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:46:59.895896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000e5bfe0f2', 'path': '/dev/dm-0', 'multipath_id': '330000000e5bfe0f2'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:46:59.895896 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5bfe0f2', 'path': '/dev/dm-0', 'multipath_id': '330000000e5bfe0f2'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:46:59.899109 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:46:59.963496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:46:59.982309 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:46:59.982574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:46:59.996048 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:00.003542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:00.097074 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:00.106132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:00.115585 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:00.116318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:00.401996 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attempting to attach volume fa95d91b-f70b-4c4d-aea3-ed734f221555 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:   <alias name="ua-fa95d91b-f70b-4c4d-aea3-ed734f221555"/>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:   <serial>fa95d91b-f70b-4c4d-aea3-ed734f221555</serial>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:00.403923 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:00.485742 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'flavor' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:00.601174 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Took 1.66 seconds to detach 3 volumes for instance.
Jun 26 02:47:00.608977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.654s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:00.610922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.882s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:00.614753 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:47:00.615499 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Claim successful on node np0000003683
Jun 26 02:47:00.675322 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Deleted allocations for instance a39d0d03-58af-46e4-b549-78cf284446c0
Jun 26 02:47:00.762244 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442020.761877, 438d9a42-bd81-4489-8c87-68f146dfc61b => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:00.762390 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] VM Started (Lifecycle Event)
Jun 26 02:47:01.064511 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:01.064511 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:01.065539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:01.065850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:01.066230 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Processing event network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:47:01.068077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:01.069046 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:47:01.069528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:01.069706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:01.069819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:01.069931 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] No waiting events found dispatching network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:01.070060 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1fd55812-8f54-4eeb-b1cd-d2b5c88dcbac req-ceba1678-7296-4c8e-840d-ebea0cb3a280 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received unexpected event network-vif-plugged-cb535a56-d9b1-4193-bbaf-14a54d385198 for instance with vm_state building and task_state spawning.
Jun 26 02:47:01.072608 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:47:01.074852 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance spawned successfully.
Jun 26 02:47:01.075209 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:47:01.108550 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:01.265329 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:01.267531 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:01.490857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:01.582827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.582827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.582827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.582827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.583145 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.583323 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:01.684624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e5517af-1b53-4aa3-9225-7d9b7c87a7d3 tempest-VolumesSnapshotTestJSON-670786988 tempest-VolumesSnapshotTestJSON-670786988-project-member] Lock "a39d0d03-58af-46e4-b549-78cf284446c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.812s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:01.770955 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:47:01.771204 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442021.7710228, 438d9a42-bd81-4489-8c87-68f146dfc61b => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:01.771333 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] VM Paused (Lifecycle Event)
Jun 26 02:47:01.924260 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:02.075872 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:02.079181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:02.079181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:02.079181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:e8:88:d5, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:02.091554 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Took 8.60 seconds to spawn the instance on the hypervisor.
Jun 26 02:47:02.091554 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:02.160953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:02.161169 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:02.275612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:02.278347 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442022.278126, 438d9a42-bd81-4489-8c87-68f146dfc61b => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:02.278682 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] VM Resumed (Lifecycle Event)
Jun 26 02:47:02.332142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:02.557717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:02.557930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:02.558160 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attaching volume c7d73690-2ab9-452d-95f1-dce4a3fa8c02 to /dev/vdb
Jun 26 02:47:02.601914 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Took 14.54 seconds to build instance.
Jun 26 02:47:02.607895 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:02.618691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:02.638190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:02.665779 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:02.675928 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:02.676200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:02.684336 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:02.687016 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe2f:6bc0'] 
Jun 26 02:47:02.687201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:02.687340 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:02.687614 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:02.687866 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating existing volume attachment record: 19a50bb4-d747-42a6-ba12-474381811499 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:02.781128 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:02.787447 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:03.104241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-febb8713-a24d-46ac-9b01-7306a04f97c3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.051s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:03.174643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.565s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:03.175518 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.067s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:03.175814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:47:03.240666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:03.241023 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:03.241215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:03.241808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:03.242117 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:03.255098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:03.255733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:03.260013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:03.260210 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:03.261026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:03.261261 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:03.272836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:03.272836 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:03.281585 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:03.281585 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02] added
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:03.287181 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:03.287665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:03.287665 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:03.287895 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02] added
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:03.292987 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:03.293332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:03.293388 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:03.293644 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:03.634502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a014b22b-828b-4529-ba2c-6c184b4a7ce6 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.545s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:03.682380 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:47:03.682722 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:47:03.682987 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:03.683360 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:03.750847 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:03.751054 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:03.778329 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13af0bfb96bf40179144f66af7baeed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419e029cdd744c1598f7a9d2bcc52340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:47:04.185424 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:47:04.192987 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Successfully created port: 155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:47:04.250340 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:04.250529 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing instance network info cache due to event network-changed-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:04.250701 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] Acquiring lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:04.251037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] Acquired lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:04.251701 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Refreshing network info cache for port 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:04.254315 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:04.288059 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:04.294743 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:04.300420 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:04.309774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.318691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.324811 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.334755 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.335065 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.341580 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.341913 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:04.379152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.40.100,3260]
Jun 26 02:47:04.379152 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:04.379152 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.385382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.50.100,3260]
Jun 26 02:47:04.385382 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:04.385382 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.395060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.400584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:04.410926 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005287830001634575 future=<Future at 0x72e29c308b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:04.411344 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:04.411510 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.694940765000183 future=<Future at 0x72e29c3d38c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:04.411555 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.694839315000081 future=<Future at 0x72e29c3d38c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:04.411936 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Emitting event <LifecycleEvent: 1782442009.4102705, cbc4f091-0c51-441b-95b4-6730199b1bf8 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:04.412075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] VM Stopped (Lifecycle Event)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.413316 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.413579 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:04.413870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:04.414020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:04.415358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] HCTL ('9', '-', '-', 0) found on session 76 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:04.415729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.416145 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:04.416331 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:04.417409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:04.417409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:04.417729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] HCTL ('10', '-', '-', 0) found on session 77 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:04.417857 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:04.440467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching for a device in session 76 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:04.440467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:04.440467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching for a device in session 77 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:04.440467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:04.688504 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:47:04.726629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:04.726629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:04.753704 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:04.760945 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.586s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:04.777750 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Successfully updated port: 155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:47:04.843008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-changed-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:04.843772 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Refreshing instance network info cache due to event network-changed-155e390e-309d-47a6-8b62-70763a8d531a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:04.843941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] Acquiring lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:04.844037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] Acquired lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:04.844152 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Refreshing network info cache for port 155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:04.851100 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Deleted allocations for instance 00f46ba2-9383-40fb-af68-61fe8d692c6d
Jun 26 02:47:04.918628 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: cbc4f091-0c51-441b-95b4-6730199b1bf8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:05.077180 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:05.230424 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:05.243956 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updated VIF entry in instance network info cache for port 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:05.244540 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating instance_info_cache with network_info: [{"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:05.261574 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:05.285938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:05.351328 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:05.423993 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:05.559273 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:05.697317 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Creating image(s)
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:05.700496 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:05.702998 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:05.704123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:05.747614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-398b6cf6-2bbe-4643-95ae-0dbe1dece5dd req-ffde88f3-60ff-4214-b4e4-b21726aeb43a service nova] Releasing lock "refresh_cache-c3cca3db-6625-4bb7-b29b-0311e5fa2e22" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:05.791364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:05.791743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:05.792138 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:05.792549 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:05.795364 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:05.795871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:05.862643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fa737365-918a-45e9-b0b4-b6d25721f667 tempest-TaggedBootDevicesTest_v242-285870187 tempest-TaggedBootDevicesTest_v242-285870187-project-member] Lock "00f46ba2-9383-40fb-af68-61fe8d692c6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.995s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:05.883060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:05.883574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:05.932585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk 1073741824" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:05.933183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:05.933662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:06.016558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:06.017276 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:47:06.017669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:06.061826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-abb70a2d-1cde-49ec-862b-d40e0d87624b req-84b0aff2-3109-4979-adee-66f8be61bdb5 service nova] Releasing lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:06.062406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:06.062681 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:06.117983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:06.118418 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Cannot resize image /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:47:06.118826 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:47:06.119049 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Ensure instance console log exists: /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:47:06.119337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:06.119612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:06.119781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:06.239188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:06.281602 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Found WWN 330000000a66ebc4c for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:06.282204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:06.282507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000a66ebc4c', 'path': '/dev/dm-1', 'multipath_id': '330000000a66ebc4c'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:06.282734 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a66ebc4c', 'path': '/dev/dm-1', 'multipath_id': '330000000a66ebc4c'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:06.287560 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'flavor' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:06.318434 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:06.318618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing instance network info cache due to event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:06.318772 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] Acquiring lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:06.318852 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] Acquired lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:06.322575 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing network info cache for port cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:06.548442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:06.548903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:06.631522 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:06.789870 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:06.792700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attempting to attach volume c7d73690-2ab9-452d-95f1-dce4a3fa8c02 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:   <alias name="ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02"/>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:   <serial>c7d73690-2ab9-452d-95f1-dce4a3fa8c02</serial>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:06.793893 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:06.824773 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:06.927311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:06.987436 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updating instance_info_cache with network_info: [{"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:07.052867 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:07.109184 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.002734932999828743 future=<Future at 0x72e29c3d38c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:07.109675 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:07.110160 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782442012.1063285, 00f46ba2-9383-40fb-af68-61fe8d692c6d => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:07.110534 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] VM Stopped (Lifecycle Event)
Jun 26 02:47:07.111744 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.614459606000082 future=<Future at 0x72e27c207950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:07.111998 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.614184934999912 future=<Future at 0x72e27c207950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:07.161168 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:07.309065 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updated VIF entry in instance network info cache for port cb535a56-d9b1-4193-bbaf-14a54d385198. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:07.309581 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating instance_info_cache with network_info: [{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:07.333638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:07.344130 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:07.344304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:07.344536 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attaching volume 6c88b1b3-589c-462d-9b8b-4847752a9338 to /dev/vdc
Jun 26 02:47:07.382857 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:07.394367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:07.420692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:07.465678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:07.466260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:07.477275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:07.480201 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe2f:6bc0'] 
Jun 26 02:47:07.480377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:07.480554 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:07.480780 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:07.481009 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating existing volume attachment record: 0ee36868-bb8d-4bd7-a1d8-8360cdd72591 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:07.489695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:07.490084 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance network_info: |[{"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:47:07.492121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Start _get_guest_xml network_info=[{"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:47:07.501208 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:07.502678 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2097260523', uuid='46ef890d-4bdc-419c-b393-b2f4bb5651d3'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442027.5022233) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:47:07.505002 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:47:07.505592 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:47:07.513965 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:47:07.514823 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:47:07.515933 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:47:07.517618 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:47:07.517618 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:47:07.517618 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:47:07.517618 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:47:07.518192 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:47:07.518192 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:47:07.518192 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:47:07.518192 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:47:07.518406 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:47:07.518547 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:47:07.518727 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:47:07.538275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2097260523',display_name='tempest-TestEncryptedCinderVolumes-server-2097260523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-2097260523',id=41,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhm+3ExH7tfL3QRb+nzxhH/cAYx7khoc3MWVMjUdWUPeaLTbIioWVFGNjAAu3YdB7FEU/XUN9csVtMN+/fYcuUxU9xN7DY8eLom8lVmCs/PcRFQj4guGpI8A/T4U97Z8w==',key_name='tempest-keypair-442487376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-rqywmh32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=46ef890d-4bdc-419c-b393-b2f4bb5651d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:47:07.538604 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:07.539566 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:07.540327 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'pci_devices' on Instance uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:07.617117 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 00f46ba2-9383-40fb-af68-61fe8d692c6d] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:07.731593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:07.811280 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-30cec0c2-f6e7-4681-927c-d286589bd2a7 req-2e3328db-eee5-444d-9549-4ba6d5975e36 service nova] Releasing lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <uuid>46ef890d-4bdc-419c-b393-b2f4bb5651d3</uuid>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <name>instance-00000029</name>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2097260523</nova:name>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:47:07</nova:creationTime>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         <nova:port uuid="155e390e-309d-47a6-8b62-70763a8d531a">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="serial">46ef890d-4bdc-419c-b393-b2f4bb5651d3</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="uuid">46ef890d-4bdc-419c-b393-b2f4bb5651d3</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.config"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:59:92:d4"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <target dev="tap155e390e-30"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/console.log" append="off"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:47:08.043971 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:47:08.047020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Preparing to wait for external event network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:47:08.047020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:08.047020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:08.047020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:08.047020 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2097260523',display_name='tempest-TestEncryptedCinderVolumes-server-2097260523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-2097260523',id=41,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhm+3ExH7tfL3QRb+nzxhH/cAYx7khoc3MWVMjUdWUPeaLTbIioWVFGNjAAu3YdB7FEU/XUN9csVtMN+/fYcuUxU9xN7DY8eLom8lVmCs/PcRFQj4guGpI8A/T4U97Z8w==',key_name='tempest-keypair-442487376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-rqywmh32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=46ef890d-4bdc-419c-b393-b2f4bb5651d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:47:08.047488 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:08.047912 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:08.048244 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:47:08.049069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.049230 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:08.049567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:47:08.057815 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.058106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a4bbdb7-8879-5598-ab85-aa323f8c8e53', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:08.061910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:08.068600 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.069728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:08.071095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.072774 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:08.073424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:08.073610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:08.077379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:08.079028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.079344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:08.079559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap155e390e-30, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:08.080129 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap155e390e-30, col_values=(('qos', UUID('369efc90-d12a-4317-8eeb-c516e97a718b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:08.081265 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap155e390e-30, col_values=(('external_ids', {'iface-id': '155e390e-309d-47a6-8b62-70763a8d531a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:92:d4', 'vm-uuid': '46ef890d-4bdc-419c-b393-b2f4bb5651d3'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:08.083955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.085599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:08.092082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:08.093955 np0000003683 nova-compute[98991]: INFO os_vif [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30')
Jun 26 02:47:08.096365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:08.097666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:08.101595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:08.102009 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:08.102725 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:08.103007 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:08.120786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:08.120786 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:08.132560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:08.132560 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338] added
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:08.134148 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:08.134454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:08.134742 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:08.134903 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338] added
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:08.147840 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:08.148084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:08.148121 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0452(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:08.148259 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:08.465486 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:08.465918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:08.465918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:08.465918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:a1:c1:08, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:09.135380 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:09.140023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:09.140245 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:09.140519 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Attaching volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 to /dev/vdb
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:09.150536 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:09.161568 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.167769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.175451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.184401 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.184890 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:09.189556 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.197586 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.197886 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:09.205656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:09.229327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.40.100,3260]
Jun 26 02:47:09.229327 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:09.229327 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.231921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:09.247538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:09.269502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:09.270071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('11', '-', '-', 0) found on session 78 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:09.270071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:09.282049 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:09.282468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:09.289334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 78 and hctl ['11', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:09.297120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:09.303644 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe2f:6bc0'] 
Jun 26 02:47:09.303842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:09.303977 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:09.304244 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:09.304532 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating existing volume attachment record: ec8dcc0f-e656-4c3e-817b-7ff675273486 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:09.622301 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:09.622858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:09.622858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:59:92:d4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:09.623193 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Using config drive
Jun 26 02:47:09.863843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:09.864273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:09.864529 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:10.019442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-192afff3-3419-4145-ab13-479bc621c20f tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.461s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:10.129124 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:10.236149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.50.100,3260]
Jun 26 02:47:10.236149 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:10.236149 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:10.242647 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Creating config drive at /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.config
Jun 26 02:47:10.244935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsz9j5vxm {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:10.262151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:10.279877 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:10.280310 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:10.280991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.178s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:10.281225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:10.282784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] HCTL ('12', '-', '-', 0) found on session 79 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:10.282958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:10.290033 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 78 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:10.290200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:10.300224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Searching for a device in session 79 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:10.300224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:10.300224 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsz9j5vxm" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:10.448216 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Rescuing
Jun 26 02:47:10.448825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:10.449047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:10.449249 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:10.726811 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004883920000793296 future=<Future at 0x72e27c207950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:10.727345 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442015.7261128, a39d0d03-58af-46e4-b549-78cf284446c0 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:10.727345 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:10.727554 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] VM Stopped (Lifecycle Event)
Jun 26 02:47:10.780510 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:10.782434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:10.813076 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:10.912850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:10.954407 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:11.037466 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a643116a-5c8b-4bbd-857a-30813a4fe779 req-d1b0f05c-6648-4a49-8349-ac1a90f84462 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:11.038060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a643116a-5c8b-4bbd-857a-30813a4fe779 req-d1b0f05c-6648-4a49-8349-ac1a90f84462 service nova] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:11.038696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a643116a-5c8b-4bbd-857a-30813a4fe779 req-d1b0f05c-6648-4a49-8349-ac1a90f84462 service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:11.038696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a643116a-5c8b-4bbd-857a-30813a4fe779 req-d1b0f05c-6648-4a49-8349-ac1a90f84462 service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:11.038696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a643116a-5c8b-4bbd-857a-30813a4fe779 req-d1b0f05c-6648-4a49-8349-ac1a90f84462 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Processing event network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:47:11.101806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:11.161017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:11.161017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:11.165788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:11.172449 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:11.194987 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:11.230339 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: a39d0d03-58af-46e4-b549-78cf284446c0] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:11.368216 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:11.532732 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:11.660928 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442031.6605682, 46ef890d-4bdc-419c-b393-b2f4bb5651d3 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:11.661099 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] VM Started (Lifecycle Event)
Jun 26 02:47:11.662641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:47:11.665137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:47:11.671064 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance spawned successfully.
Jun 26 02:47:11.676036 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:47:11.933625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:12.034981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:12.122354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found WWN 330000000c5246236 for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:12.122775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:12.123161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== connect_volume: return (4049ms) {'type': 'block', 'scsi_wwn': '330000000c5246236', 'path': '/dev/dm-2', 'multipath_id': '330000000c5246236'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:12.123343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5246236', 'path': '/dev/dm-2', 'multipath_id': '330000000c5246236'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:12.123828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.259s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:12.124084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:12.128308 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:12.138275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:12.138798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:12.139059 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:12.139969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:12.140832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:12.141066 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:12.157762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:12.157762 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:12.158180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:12.158180 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:12.164077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:12.170945 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016] added
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:12.173535 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:12.174267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:12.174657 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:12.174854 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016] added
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:12.178752 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:12.178935 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:12.179138 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:12.179271 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:12.181976 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.184094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.184094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.184094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.184094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.184969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:12.630662 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attempting to attach volume 6c88b1b3-589c-462d-9b8b-4847752a9338 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:   <alias name="ua-6c88b1b3-589c-462d-9b8b-4847752a9338"/>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:   <serial>6c88b1b3-589c-462d-9b8b-4847752a9338</serial>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:12.632408 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:12.674444 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:47:12.674780 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442032.6746016, 46ef890d-4bdc-419c-b393-b2f4bb5651d3 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:12.674868 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] VM Paused (Lifecycle Event)
Jun 26 02:47:12.696077 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Took 7.00 seconds to spawn the instance on the hypervisor.
Jun 26 02:47:12.696077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:12.991566 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.086355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.097563 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:13.098535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:13.098841 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:13.099048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:13.099247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] No waiting events found dispatching network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:13.099524 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-26fbd494-c28f-4dad-8401-318218285050 req-4f46c536-0790-46a5-9ecf-d80f9aeaf36c service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received unexpected event network-vif-plugged-155e390e-309d-47a6-8b62-70763a8d531a for instance with vm_state active and task_state None.
Jun 26 02:47:13.175367 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:13.177083 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:13.179750 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:13.182453 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442033.1821284, 46ef890d-4bdc-419c-b393-b2f4bb5651d3 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:13.182611 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] VM Resumed (Lifecycle Event)
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:13.191066 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:13.196119 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.204248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.210763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.211667 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Took 13.53 seconds to build instance.
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.225503 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.229871 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.230081 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:13.284986 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.50.100,3260]
Jun 26 02:47:13.284986 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:13.284986 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.299272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.307570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.40.100,3260]
Jun 26 02:47:13.307570 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:13.307570 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.320882 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.321510 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:13.322572 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:13.322653 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:13.322946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:13.324469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('15', '-', '-', 0) found on session 80 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:13.324631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.344314 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:13.344695 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:13.345011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:13.345011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:13.345652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 80 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:13.347953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:13.354954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('16', '-', '-', 0) found on session 81 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:13.354954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:13.371849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 81 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:13.371849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:13.685271 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:13.689772 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:13.692371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.701669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.715341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2dc1fcdf-8393-4b6c-ab8d-1e4361537e2b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.041s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:13.718415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.885219 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.894098 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:13.982665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:13.982845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:13.983044 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:13.983226 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:13.983283 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:13.983425 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-0ef9e086-2521-4d25-9fb3-4fde582fe9ea req-6b8f1fb9-624f-4e69-8fcf-e58506e0f2e6 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state rescuing.
Jun 26 02:47:14.034135 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance destroyed successfully.
Jun 26 02:47:14.035784 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'numa_topology' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:14.141808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:14.196739 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99975491400005 future=<Future at 0x72e29c3f1220 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:14.196739 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999551997000026 future=<Future at 0x72e29c3f1220 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:14.196739 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999433584999906 future=<Future at 0x72e29c3f1220 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:14.329672 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:14.329802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:14.329901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:14.329983 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:14.330080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] No VIF found with MAC fa:16:3e:e8:88:d5, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:14.491089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-changed-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:14.491578 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Refreshing instance network info cache due to event network-changed-155e390e-309d-47a6-8b62-70763a8d531a. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:14.491736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] Acquiring lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:14.491879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] Acquired lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:14.491997 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Refreshing network info cache for port 155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:14.540721 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attempting rescue
Jun 26 02:47:14.541758 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98991) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 26 02:47:14.545342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:47:14.545530 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Creating image(s)
Jun 26 02:47:14.546258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:14.546471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:14.547199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:14.547199 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:14.994708 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:15.048938 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:15.049724 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:15.053912 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:15.056110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:15.056519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:15.056883 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:15.060966 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:15.061400 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:15.159421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:15.159996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.rescue {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:15.174190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000001243ebed for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:15.176034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:15.178850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (5314ms) {'type': 'block', 'scsi_wwn': '3300000001243ebed', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ebed'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:15.179160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001243ebed', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ebed'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:15.191642 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:15.226179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.rescue" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:15.226179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:15.226739 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'migration_context' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:15.374469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:15.412935 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:15.549068 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updated VIF entry in instance network info cache for port 155e390e-309d-47a6-8b62-70763a8d531a. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:15.550031 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updating instance_info_cache with network_info: [{"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:15.699669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Attempting to attach volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:15.703601 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:15.729977 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:15.731882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:47:15.731882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start _get_guest_xml network_info=[{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:a1:c1:08"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:47:15.731882 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:15.914500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5145e750-3107-4cfa-8481-ed8b5fddfd0f tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.569s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:16.052717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5244d4e9-4547-4847-9b32-012daaa09163 req-28be3303-f33e-4c60-9a1f-a17fa10bf4f3 service nova] Releasing lock "refresh_cache-46ef890d-4bdc-419c-b393-b2f4bb5651d3" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:16.062512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:16.062512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:16.062685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:16.062744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:16.062911 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:16.063630 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-853a72bf-7a30-44a4-9888-9287386bd187 req-9521d8ac-4ecf-44d9-9708-66233f45f5ed service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state rescuing.
Jun 26 02:47:16.233074 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:16.237858 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:16.239142 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1868442542', uuid='35615762-25e8-4ae1-98b8-c0dd0083e709'), owner=OwnerMeta(userid='94a20c5b3a594daaacb7bef508d1ee86', username='tempest-ServerRescueNegativeTestJSON-1027165143-project-member', projectid='d2b07c33d4ed466ca32fa63a7e8b74e4', projectname='tempest-ServerRescueNegativeTestJSON-1027165143'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:a1:c1:08"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442036.2387488) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:47:16.240369 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:47:16.241027 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:47:16.242057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:47:16.242310 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:47:16.243447 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:47:16.243848 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:47:16.244040 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:47:16.244217 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:47:16.244456 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:47:16.244704 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:47:16.244869 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:47:16.245092 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:47:16.245310 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:47:16.245527 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:47:16.245698 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:47:16.245869 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:47:16.246043 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:16.572795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:16.572944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:16.748063 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:16.766930 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868442542',display_name='tempest-ServerRescueNegativeTestJSON-server-1868442542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1868442542',id=37,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxXpYanSUxxppgp1pXTr0qK/foEs6Vexq2CEFusaauLeujVxHcSB/Hz60V9zNvS9YCHaUnUtLIyf+OPJHdoKAZfLWqHtvwi5YM/+jyGRBpbhXpEUKiyBoestMnqTVfoJw==',key_name='tempest-keypair-1387228019',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:32Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-zjie408o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=35615762-25e8-4ae1-98b8-c0dd0083e709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:a1:c1:08"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:47:16.767185 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "vif_mac": "fa:16:3e:a1:c1:08"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:16.768013 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:16.769068 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'pci_devices' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:16.932469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:17.075141 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Detaching volume fa95d91b-f70b-4c4d-aea3-ed734f221555
Jun 26 02:47:17.123611 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attempting to driver detach volume fa95d91b-f70b-4c4d-aea3-ed734f221555 from mountpoint /dev/vdb
Jun 26 02:47:17.132440 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdb by alias ua-fa95d91b-f70b-4c4d-aea3-ed734f221555 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:17.136719 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdb by alias ua-fa95d91b-f70b-4c4d-aea3-ed734f221555 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:17.136905 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Attempting to detach device vdb from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <alias name="ua-fa95d91b-f70b-4c4d-aea3-ed734f221555"/>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <serial>fa95d91b-f70b-4c4d-aea3-ed734f221555</serial>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:17.137218 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:17.147434 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdb from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the persistent domain config.
Jun 26 02:47:17.147660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] (1/8): Attempting to detach device vdb with device alias ua-fa95d91b-f70b-4c4d-aea3-ed734f221555 from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <alias name="ua-fa95d91b-f70b-4c4d-aea3-ed734f221555"/>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <serial>fa95d91b-f70b-4c4d-aea3-ed734f221555</serial>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:17.148003 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:17.271280 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <uuid>35615762-25e8-4ae1-98b8-c0dd0083e709</uuid>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <name>instance-00000025</name>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1868442542</nova:name>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:47:16</nova:creationTime>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:user uuid="94a20c5b3a594daaacb7bef508d1ee86">tempest-ServerRescueNegativeTestJSON-1027165143-project-member</nova:user>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:project uuid="d2b07c33d4ed466ca32fa63a7e8b74e4">tempest-ServerRescueNegativeTestJSON-1027165143</nova:project>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         <nova:port uuid="cd1b6c07-e35a-4adb-a942-f1637c0b96a7">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="serial">35615762-25e8-4ae1-98b8-c0dd0083e709</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="uuid">35615762-25e8-4ae1-98b8-c0dd0083e709</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.rescue"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config.rescue"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:a1:c1:08"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <target dev="tapcd1b6c07-e3"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/console.log" append="off"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:47:17.272327 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:47:17.279695 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance destroyed successfully.
Jun 26 02:47:17.357000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:17.357162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:17.357201 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:17.357300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:29:66:09, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:17.671907 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442037.6714664, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => ua-fa95d91b-f70b-4c4d-aea3-ed734f221555> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:17.673317 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fa95d91b-f70b-4c4d-aea3-ed734f221555 for instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:17.677866 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdb from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the live domain config.
Jun 26 02:47:17.679122 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:47:17.679592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:17.679785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:17.680263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:17.680740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa95d91b-f70b-4c4d-aea3-ed734f221555', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:47:17.680925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:17.717837 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:17.718214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '81')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:47:17.718657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', '74')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:17.719854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555', '75')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:17.721152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c5813a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:47:17.721426 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:47:17.721719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flush multipath device 330000000e5bfe0f2 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:47:17.759350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:17.811089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:17.861021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:47:17.861185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:47:17.863296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:47:17.877230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:47:17.877810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:47:17.892271 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:17.936062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.40.100,3260]
Jun 26 02:47:17.936062 np0000003683 nova-compute[98991]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:17.936062 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:17.961534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:17.975248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:18.018675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.50.100,3260]
Jun 26 02:47:18.018675 np0000003683 nova-compute[98991]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-fa95d91b-f70b-4c4d-aea3-ed734f221555, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:18.018675 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:18.037291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:18.037546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:18.037746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== disconnect_volume: return (358ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:18.037787 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:47:18.099252 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:18.599375 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:18.606210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:18.606891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:18.797455 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:18.797660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:18.797828 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:18.798442 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] No VIF found with MAC fa:16:3e:a1:c1:08, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:18.799275 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Using config drive
Jun 26 02:47:18.907849 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b3f693a-cf12-41c1-bc09-191e56eba82f tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.767s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:19.109965 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:19.303189 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'ec2_ids' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:19.606290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-18d39b37-9ed5-46b9-8d62-e5496d057e87 tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:19.808986 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:19.809145 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'keypairs' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:19.826539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:19.843626 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:19.843888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:19.942598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:19.942766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:20.117850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:20.311940 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:20.315199 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:20.347813 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Detaching volume 0cefb5ab-dba0-478a-a0e4-8fac6972e5a5
Jun 26 02:47:20.404956 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Attempting to driver detach volume 0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 from mountpoint /dev/vdc
Jun 26 02:47:20.414828 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Found disk vdc by alias ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Found disk vdc by alias ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Attempting to detach device vdc from instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <alias name="ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5"/>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-9"/>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <serial>0cefb5ab-dba0-478a-a0e4-8fac6972e5a5</serial>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:20.416139 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:20.421187 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully detached device vdc from instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb from the persistent domain config.
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] (1/8): Attempting to detach device vdc with device alias ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 from instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <alias name="ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5"/>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-9"/>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <serial>0cefb5ab-dba0-478a-a0e4-8fac6972e5a5</serial>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:20.421901 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:20.449343 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Detaching volume 6c88b1b3-589c-462d-9b8b-4847752a9338
Jun 26 02:47:20.474176 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Creating config drive at /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config.rescue
Jun 26 02:47:20.481267 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgpv24aq1 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:20.505229 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Attempting to driver detach volume 6c88b1b3-589c-462d-9b8b-4847752a9338 from mountpoint /dev/vdc
Jun 26 02:47:20.522105 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdc by alias ua-6c88b1b3-589c-462d-9b8b-4847752a9338 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:20.524575 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Found disk vdc by alias ua-6c88b1b3-589c-462d-9b8b-4847752a9338 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:20.524706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Attempting to detach device vdc from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <alias name="ua-6c88b1b3-589c-462d-9b8b-4847752a9338"/>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <serial>6c88b1b3-589c-462d-9b8b-4847752a9338</serial>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:20.525412 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdc from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the persistent domain config.
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] (1/8): Attempting to detach device vdc with device alias ua-6c88b1b3-589c-462d-9b8b-4847752a9338 from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <alias name="ua-6c88b1b3-589c-462d-9b8b-4847752a9338"/>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <serial>6c88b1b3-589c-462d-9b8b-4847752a9338</serial>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:20.541106 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:20.547423 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgpv24aq1" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:21.032739 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.066680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.071561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.109047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442041.1042697, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:21.110966 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 for instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:21.116917 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully detached device vdc from instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb from the live domain config.
Jun 26 02:47:21.120737 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:47:21.121135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:21.121981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:21.121981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:21.122298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:47:21.122505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.156506 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:21.156943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '81')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:47:21.157247 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '70')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:21.158350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5', '71')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:21.159289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3184a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'): ({'sdm'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:47:21.159510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Removing multipathed devices sdl, sdm {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:47:21.159811 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flush multipath device 33000000029b0d7f3 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:47:21.197195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:21.209054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.213087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:21.214303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:21.214303 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Attaching volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 to /dev/vdb
Jun 26 02:47:21.235703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:21.236013 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:21.237313 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:21.237564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:21.239385 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:21.240765 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7f61087e-064e-4706-bc1d-35a0fb62d0ae req-e588bb2d-0caf-43e7-8802-bd3404157698 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state rescuing.
Jun 26 02:47:21.241878 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.266192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:21.278572 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:21.293600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:21.317422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:47:21.317658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:47:21.318900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:47:21.326083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:21.339275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:47:21.339869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:47:21.359272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.373417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442041.371914, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => ua-6c88b1b3-589c-462d-9b8b-4847752a9338> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:21.374918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:21.375134 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-6c88b1b3-589c-462d-9b8b-4847752a9338 for instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:21.375923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:21.378001 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully detached device vdc from instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 from the live domain config.
Jun 26 02:47:21.379538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:47:21.379842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:21.380010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:21.385818 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:21.387592 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee8:88d5', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe0b:2fb0', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe59:92d4', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea1:c108'] 
Jun 26 02:47:21.387742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:21.387846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:21.388318 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:21.388318 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating existing volume attachment record: 09710511-4870-41ca-ba51-04fd550b8cd8 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:21.394836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.40.100,3260]
Jun 26 02:47:21.394836 np0000003683 nova-compute[98991]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:21.394836 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.415012 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.427384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.466718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.50.100,3260]
Jun 26 02:47:21.466718 np0000003683 nova-compute[98991]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-0cefb5ab-dba0-478a-a0e4-8fac6972e5a5, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:21.466718 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.488288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.488638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:21.488810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] <== disconnect_volume: return (367ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:21.488969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:47:21.491335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.111s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:21.493436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c88b1b3-589c-462d-9b8b-4847752a9338', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:47:21.493650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.521960 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:21.522289 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '81')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:47:21.522673 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '78')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:21.523459 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338', '79')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:21.525639 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7313a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:47:21.525848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:47:21.526178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Flush multipath device 330000000c5246236 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:47:21.579005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:21.620080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:21.680742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:47:21.680897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:47:21.681852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:47:21.692803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:47:21.692961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:47:21.706568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.750740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.40.100,3260]
Jun 26 02:47:21.750740 np0000003683 nova-compute[98991]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:21.750740 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.766339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.777393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.818918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.50.100,3260]
Jun 26 02:47:21.818918 np0000003683 nova-compute[98991]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6c88b1b3-589c-462d-9b8b-4847752a9338, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:21.818918 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.841535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.841785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:21.841922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] <== disconnect_volume: return (462ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:21.842070 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:47:21.934524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:21.949493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:21.949801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:21.949954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:21.950265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:21.950462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:21.961569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:21.962077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:21.962538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:21.962752 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:21.963016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:21.963233 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:21.975550 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:21.977912 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:21.992688 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:22.001180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.008358 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.008621 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:22.008740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:22.008851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:22.009285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('15', '0', '0', 0) found on session 80 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:22.009393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.019253 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:22.019404 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:22.019631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:22.019751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:22.020398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('16', '0', '0', 0) found on session 81 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:22.020579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:22.020903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 80 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:22.021032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:22.031891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 81 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:22.031992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:22.036778 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'flavor' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:22.049065 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 35615762-25e8-4ae1-98b8-c0dd0083e709 due to new event <LifecycleEvent: 1782442042.0487776, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:47:22.049214 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442042.0487776, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:22.053407 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Resumed (Lifecycle Event)
Jun 26 02:47:22.057107 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9bb8e381-811a-4042-9e8a-f2d1ea8e78b5 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:22.398181 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'flavor' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:22.555807 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:22.558574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:22.963056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:23.045974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca83c5e1-a1cc-4a65-a111-9ba1c33c8ed7 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.202s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:23.061745 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442043.0614588, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:23.061861 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Started (Lifecycle Event)
Jun 26 02:47:23.102022 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:23.227398 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Unrescuing
Jun 26 02:47:23.227598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:23.227712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:23.227869 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:23.308564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:23.309024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:23.309197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:23.309352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:23.309534 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:23.309687 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e90d38a6-236a-4310-b744-8c123bb891de req-7ae35a30-088c-4eb3-ab75-9ec4a51af036 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:47:23.405640 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-beeead24-588c-414c-9e90-4d89a30f3beb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.463s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:23.565947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:23.573218 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:23.577596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:23.729923 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:23.989495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000001243ebed for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:23.989661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:23.990216 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '3300000001243ebed', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ebed'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:23.990216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001243ebed', 'path': '/dev/dm-3', 'multipath_id': '3300000001243ebed'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:23.995347 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:24.082952 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:24.085756 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 26 02:47:24.206120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:24.206324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:24.206598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:24.206760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:24.209297 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:24.212402 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Terminating instance
Jun 26 02:47:24.258586 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:24.498274 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Attempting to attach volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:24.499431 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:24.503430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:24.503672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:24.503880 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:24.504047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:24.504195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:24.506151 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Terminating instance
Jun 26 02:47:24.716690 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:47:24.741995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:24.745722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:24.760799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:24.761325 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'flavor' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:24.775616 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:24.792944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:24.824110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:24.951181 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:24.951435 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:24.951697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:24.951855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:24.952003 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:24.952152 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0b91ead8-4de6-4f68-8384-12a84d85b14b req-7beabc2e-2539-478f-9acf-2bab3a716007 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:47:25.008996 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:47:25.054092 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.057303 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.081569 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999724336999861 future=<Future at 0x72e27c268980 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:25.085242 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Instance destroyed successfully.
Jun 26 02:47:25.085242 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'resources' on Instance uuid d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:25.085242 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.125403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.320833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.325184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.357525 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999757087999797 future=<Future at 0x72e27c28d9a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:25.362058 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Instance destroyed successfully.
Jun 26 02:47:25.362468 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lazy-loading 'resources' on Instance uuid be25294a-11d9-453a-8fc1-9ffc77dbc4a7 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:25.368343 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.510172 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.558808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.561683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.589449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-597508233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-597508233',id=28,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvO1UHKROvy+5e2T1Ppg7iE9fMVkvTm1AL8Lz0UEpfobDil5CPz9RWu5Fcqtg+lxa0qxeI7Eo8xysl2p+txVpAb4hX8kx55VqbzJLsN42CSxsPBDT6c0nsE0pADs7dQag==',key_name='tempest-keypair-1639916074',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:42Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-uz0e5wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:47:25.589690 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "8d73365b-ab16-4a51-8329-11ab8872174f", "address": "fa:16:3e:0b:2f:b0", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d73365b-ab", "ovs_interfaceid": "8d73365b-ab16-4a51-8329-11ab8872174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:25.590302 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:25.590592 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:47:25.592772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.593081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d73365b-ab, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:25.594424 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.595422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:25.610986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.612256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.612487 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ff66caf-0f70-460f-a7b4-0e4a1013c649) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:25.613125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.613903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:25.634630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.636607 np0000003683 nova-compute[98991]: INFO os_vif [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=8d73365b-ab16-4a51-8329-11ab8872174f,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d73365b-ab')
Jun 26 02:47:25.636921 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Deleting instance files /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb_del
Jun 26 02:47:25.647155 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99974396399989 future=<Future at 0x72e27c28ee40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:25.647663 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Deletion of /opt/stack/data/nova/instances/d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb_del complete
Jun 26 02:47:25.651829 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance destroyed successfully.
Jun 26 02:47:25.652830 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'numa_topology' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:25.663754 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:25.664031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:25.664252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:25.664432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:25.664612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:25.664781 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-600d8ff9-8d15-4866-a6fd-83f41d441bfc req-6fdcfd7f-c64e-4653-907d-f6017c4b591a service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state rescued and task_state unrescuing.
Jun 26 02:47:25.868025 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-958007171',display_name='tempest-AttachVolumeTestJSON-server-958007171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumetestjson-server-958007171',id=35,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRvLv1El4K7oltnvKzthKknDEgNInFAUrpgH2pB9m49OAZHBXPtRLSR52EexyfK91Vqhd6ZZ9lp2HoT1Hid5tWXfSJFKhl9AhnsAsTOxm7f9Xe8VMgJHkjPyEJ/S6jOQ==',key_name='tempest-keypair-2056094544',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:13Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f149d284f0d24070afe71cccd4c0c744',ramdisk_id='',reservation_id='r-z6y5lw17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-391502958',owner_user_name='tempest-AttachVolumeTestJSON-391502958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b19b282009bd41bd924982574984e524',uuid=be25294a-11d9-453a-8fc1-9ffc77dbc4a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:47:25.868206 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converting VIF {"id": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "address": "fa:16:3e:e8:88:d5", "network": {"id": "8109d511-6aec-44ea-b0bd-c99b6a8bf693", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1500565142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f149d284f0d24070afe71cccd4c0c744", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123f28d0-45", "ovs_interfaceid": "123f28d0-45a7-49ba-a7d6-4a48ecc742bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:25.868726 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:25.868915 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:47:25.869599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.869769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap123f28d0-45, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:25.870691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.871569 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:25.875627 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.876401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.876578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a49e37f-8f28-4b6e-bd23-91f236a92d85) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:25.876968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.877422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:25.881214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:25.882892 np0000003683 nova-compute[98991]: INFO os_vif [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb,network=Network(8109d511-6aec-44ea-b0bd-c99b6a8bf693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123f28d0-45')
Jun 26 02:47:25.883110 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Deleting instance files /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7_del
Jun 26 02:47:25.883809 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Deletion of /opt/stack/data/nova/instances/be25294a-11d9-453a-8fc1-9ffc77dbc4a7_del complete
Jun 26 02:47:26.154768 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Object Instance<35615762-25e8-4ae1-98b8-c0dd0083e709> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:47:26.159652 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 26 02:47:26.160208 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:47:26.160520 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:47:26.160613 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:47:26.160831 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:26.174030 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:26.174217 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:26.174366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:26.174534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:2f:6b:c0, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:26.294809 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:26.389795 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:47:26.390826 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:47:26.391198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:47:26.391346 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:47:26.391679 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:26.518352 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:26.625777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:26.626003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:26.647050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:26.678735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:26.684921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:26.793230 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:26.842927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8c65eebc-9b9f-4f32-85f1-f8cdb42c850f req-0bb78076-f811-4491-96f3-d19e9d146e5e service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-deleted-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:26.843103 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-8c65eebc-9b9f-4f32-85f1-f8cdb42c850f req-0bb78076-f811-4491-96f3-d19e9d146e5e service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Neutron deleted interface 8d73365b-ab16-4a51-8329-11ab8872174f; detaching it from the instance and deleting it from the info cache
Jun 26 02:47:26.843578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:26.846017 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8c65eebc-9b9f-4f32-85f1-f8cdb42c850f req-0bb78076-f811-4491-96f3-d19e9d146e5e service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Detach interface failed, port_id=8d73365b-ab16-4a51-8329-11ab8872174f, reason: Instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:47:26.936308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:27.022907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:27.023134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] Acquiring lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:27.023291 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:27.023602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:27.023681 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] No waiting events found dispatching network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:27.023976 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f98b0f54-6c61-4e35-aa5d-4e15d238d8fc req-7a9dc14a-b2e1-4825-b85d-c5b14786f549 service nova] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Received event network-vif-unplugged-8d73365b-ab16-4a51-8329-11ab8872174f for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:47:27.129494 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:27.279486 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:27.462587 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 35615762-25e8-4ae1-98b8-c0dd0083e709 due to new event <LifecycleEvent: 1782442047.4615648, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:47:27.462933 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442047.4615648, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:27.463115 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Resumed (Lifecycle Event)
Jun 26 02:47:27.464425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b82681a7-d44d-4b18-ba74-1e0bace50add tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:27.509773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1df2ae14-541f-4437-baf8-afac2857dac6 req-37553826-463b-4a81-954d-967eabc49b79 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Received event network-vif-deleted-123f28d0-45a7-49ba-a7d6-4a48ecc742bb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:27.511419 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-1df2ae14-541f-4437-baf8-afac2857dac6 req-37553826-463b-4a81-954d-967eabc49b79 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Neutron deleted interface 123f28d0-45a7-49ba-a7d6-4a48ecc742bb; detaching it from the instance and deleting it from the info cache
Jun 26 02:47:27.512598 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1df2ae14-541f-4437-baf8-afac2857dac6 req-37553826-463b-4a81-954d-967eabc49b79 service nova] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Detach interface failed, port_id=123f28d0-45a7-49ba-a7d6-4a48ecc742bb, reason: Instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:47:27.737769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:27.741707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:27.741965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:27.742139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:27.742311 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:27.742513 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state None.
Jun 26 02:47:27.742671 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:27.742846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:27.743033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:27.743189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:27.743347 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:27.743539 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state None.
Jun 26 02:47:27.743691 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:27.743862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:27.744046 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:27.744201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:27.744357 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:27.747244 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a5a07d28-3348-46e9-8823-164db2262ca9 req-646df13a-c00c-4f48-b28c-9f8340fb0983 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received unexpected event network-vif-plugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with vm_state active and task_state None.
Jun 26 02:47:27.758621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dae13307-ee45-45df-9163-898273e9cb71 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.543s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:27.781633 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Took 1.62 seconds to deallocate network for instance.
Jun 26 02:47:27.942024 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:27.965876 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:27.969723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:28.143464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:28.268362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:28.268601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:28.287712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:28.288333 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:28.445401 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Took 2.05 seconds to deallocate network for instance.
Jun 26 02:47:28.476758 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442048.4740846, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:28.476758 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Started (Lifecycle Event)
Jun 26 02:47:28.773896 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Detaching volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:28.831018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:28.844117 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Attempting to driver detach volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 from mountpoint /dev/vdb
Jun 26 02:47:28.861555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Attempting to detach device vdb from instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:28.865770 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:28.880802 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 from the persistent domain config.
Jun 26 02:47:28.880802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] (1/8): Attempting to detach device vdb with device alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 from instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:28.881033 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:28.918469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:28.918469 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:28.939845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:28.954883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:28.979191 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:28.982491 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:29.195179 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003872090001095785 future=<Future at 0x72e29c3f1220 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:29.195267 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:29.195355 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.884541271999979 future=<Future at 0x72e27c268980 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:29.195456 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.884437477999882 future=<Future at 0x72e27c268980 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:29.244984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:29.245150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:29.245320 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Attaching volume 753ab8b1-95f2-4a20-953f-4e7c0fe15161 to /dev/vdb
Jun 26 02:47:29.293734 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:29.311362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:29.335654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:29.381978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:29.382406 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:29.395292 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:29.396048 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fef5:5c00', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe59:92d4', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea1:c108'] 
Jun 26 02:47:29.396203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:29.396303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:29.397040 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:29.397332 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updating existing volume attachment record: 96a4f509-3779-4def-abc2-b3b35e6fda44 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:29.403046 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 for instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:29.422025 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:29.485295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442049.4848082, c3cca3db-6625-4bb7-b29b-0311e5fa2e22 => ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:29.494843 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 from the live domain config.
Jun 26 02:47:29.589040 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:29.589208 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing instance network info cache due to event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:29.589542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:29.589613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:29.589755 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:29.931817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.643s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:29.933903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.979s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:29.952839 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:29.953169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:29.953309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:29.953732 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:29.953946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:29.967671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:29.968498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:29.968928 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:29.969567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:29.969849 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:29.970121 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:29.984137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:29.984137 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:29.991815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:29.991815 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161] added
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:30.002225 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:30.002504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:30.002959 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:30.002959 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:30.007653 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Deleted allocations for instance d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161] added
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:30.010262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:30.010604 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:30.010604 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:30.045026 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Detected multiple connections on this host for volume: a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, skipping target disconnect.
Jun 26 02:47:30.092902 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:30.529581 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:30.530012 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:30.539070 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:30.606293 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:30.692021 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updated VIF entry in instance network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:30.692274 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:30.888008 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:31.003290 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:31.011111 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:31.019107 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.022236 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-05c2eb13-d546-4eeb-9d23-25e20e18d169 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.813s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:31.025278 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.034165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.036401 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:31.046435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.052517 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.062194 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.062569 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:31.092282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.40.100,3260]
Jun 26 02:47:31.092282 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:31.092282 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.101953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.50.100,3260]
Jun 26 02:47:31.101953 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:31.101953 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.107229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.114696 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.129433 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.129759 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:31.129995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:31.130147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.132656 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:31.133061 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:31.133581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('7', '-', '-', 0) found on session 82 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:31.133672 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:31.133963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:31.134230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:31.135514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] HCTL ('8', '-', '-', 0) found on session 83 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:31.135646 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:31.163791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:31.163791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:31.163791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Searching for a device in session 83 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:31.163791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:31.194424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:31.194694 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:31.194876 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing instance network info cache due to event network-changed-cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:31.195100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Acquiring lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:31.195196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Acquired lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:31.195398 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Refreshing network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:31.350548 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:31.547709 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.614s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:31.600502 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Deleted allocations for instance be25294a-11d9-453a-8fc1-9ffc77dbc4a7
Jun 26 02:47:31.615465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0de6dfd2-ce0a-4f8a-8c4a-8c3ac6925450 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.346s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:31.687072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:31.687255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:31.697837 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:31.938731 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:31.970437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:32.132955 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:32.191117 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Detaching volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016
Jun 26 02:47:32.243431 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Attempting to driver detach volume a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 from mountpoint /dev/vdb
Jun 26 02:47:32.247488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:32.248814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:32.248929 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Attempting to detach device vdb from instance 438d9a42-bd81-4489-8c87-68f146dfc61b from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:32.249238 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:32.255445 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance 438d9a42-bd81-4489-8c87-68f146dfc61b from the persistent domain config.
Jun 26 02:47:32.255644 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] (1/8): Attempting to detach device vdb with device alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 from instance 438d9a42-bd81-4489-8c87-68f146dfc61b from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <alias name="ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016"/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <serial>a9f76cd5-30ae-41f5-9c14-7a4e52c7e016</serial>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:32.255902 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:32.274727 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updated VIF entry in instance network info cache for port cd1b6c07-e35a-4adb-a942-f1637c0b96a7. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:32.275328 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [{"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:32.609239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-497aa1a4-a0d4-4594-8cf3-e23b0b2d87eb tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Lock "be25294a-11d9-453a-8fc1-9ffc77dbc4a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.105s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:32.776730 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-961ad708-e865-431a-ad28-5278ae78ba7d req-325909e6-bbda-4d49-9821-87589da09890 service nova] Releasing lock "refresh_cache-35615762-25e8-4ae1-98b8-c0dd0083e709" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:32.988694 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found WWN 33000000069322ad2 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:32.988946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:32.989095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000069322ad2', 'path': '/dev/dm-0', 'multipath_id': '33000000069322ad2'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:32.989205 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069322ad2', 'path': '/dev/dm-0', 'multipath_id': '33000000069322ad2'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:32.995656 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:33.499817 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Attempting to attach volume 753ab8b1-95f2-4a20-953f-4e7c0fe15161 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:   <alias name="ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161"/>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:   <serial>753ab8b1-95f2-4a20-953f-4e7c0fe15161</serial>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:33.500863 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:47:34.313570 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:34.313786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:34.815457 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:47:35.161022 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:35.161162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:35.161266 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:35.161381 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] No VIF found with MAC fa:16:3e:f5:5c:00, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:35.336379 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442055.3358538, 438d9a42-bd81-4489-8c87-68f146dfc61b => ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:35.339815 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 for instance 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:35.341977 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance 438d9a42-bd81-4489-8c87-68f146dfc61b from the live domain config.
Jun 26 02:47:35.378301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:35.378487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:35.381840 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:47:35.381964 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Claim successful on node np0000003683
Jun 26 02:47:35.398411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:47:35.398747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:35.398880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:35.399175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:35.399522 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:47:35.399670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:35.435095 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:35.435800 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:35.436167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '83')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:47:35.436167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '81')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:35.439517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016', '80')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:35.439517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c473d80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:47:35.439517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:47:35.439517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flush multipath device 3300000001243ebed {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:47:35.477933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:35.529057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:35.586891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:47:35.587011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:47:35.587939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:47:35.601109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:47:35.601306 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:47:35.615937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.650168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.40.100,3260]
Jun 26 02:47:35.650168 np0000003683 nova-compute[98991]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:35.650168 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.669568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.683708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.720702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.50.100,3260]
Jun 26 02:47:35.720702 np0000003683 nova-compute[98991]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-a9f76cd5-30ae-41f5-9c14-7a4e52c7e016, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:35.720702 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.738760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:35.739059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:35.739158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== disconnect_volume: return (340ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:35.739208 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:47:35.890159 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:36.287110 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:36.725591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c281e0ed-d25c-413e-8c3e-40944f14ebdd tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.480s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:36.909946 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:36.910469 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:36.939873 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:37.299277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e87b84f1-a902-43ce-bff5-5183bb2f2de3 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.612s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:37.318573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:37.318779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:37.415017 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:37.821471 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Detaching volume 753ab8b1-95f2-4a20-953f-4e7c0fe15161
Jun 26 02:47:37.868724 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Attempting to driver detach volume 753ab8b1-95f2-4a20-953f-4e7c0fe15161 from mountpoint /dev/vdb
Jun 26 02:47:37.872764 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:37.873851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Found disk vdb by alias ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:47:37.873952 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Attempting to detach device vdb from instance f209d7e5-1a71-4b80-9b35-f05f0f860265 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <alias name="ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161"/>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <serial>753ab8b1-95f2-4a20-953f-4e7c0fe15161</serial>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:37.874197 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:37.882185 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance f209d7e5-1a71-4b80-9b35-f05f0f860265 from the persistent domain config.
Jun 26 02:47:37.882343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] (1/8): Attempting to detach device vdb with device alias ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161 from instance f209d7e5-1a71-4b80-9b35-f05f0f860265 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <alias name="ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161"/>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <serial>753ab8b1-95f2-4a20-953f-4e7c0fe15161</serial>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:47:37.882641 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:47:37.921294 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.543s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:37.922607 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:47:38.406702 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442058.4063118, f209d7e5-1a71-4b80-9b35-f05f0f860265 => ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:47:38.409697 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-753ab8b1-95f2-4a20-953f-4e7c0fe15161 for instance f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:47:38.415701 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully detached device vdb from instance f209d7e5-1a71-4b80-9b35-f05f0f860265 from the live domain config.
Jun 26 02:47:38.420447 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:47:38.420542 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:38.421273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:38.428782 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:47:38.429235 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:47:38.429792 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:38.431988 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:38.570662 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7340727e31547a4b39299401535770d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7eadbb081143fb8f96d0187a0f7c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:47:38.586956 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:38.930814 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:47:39.149096 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Successfully created port: 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:47:39.246051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:39.246268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:39.435992 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:47:39.673383 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Successfully updated port: 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:47:39.720719 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:39.720825 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing instance network info cache due to event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:39.720973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:39.721062 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:39.721182 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:39.749019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:47:40.080464 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005275180001262925 future=<Future at 0x72e27c268980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.080793 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.080793 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.27657177999981286 future=<Future at 0x72e27c28d9a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.080793 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.2764766629998121 future=<Future at 0x72e27c28d9a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.081128 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442045.079829, d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:40.081302 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] VM Stopped (Lifecycle Event)
Jun 26 02:47:40.174451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:40.224138 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:40.291748 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:40.299948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:40.300151 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:40.303558 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:47:40.303730 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Claim successful on node np0000003683
Jun 26 02:47:40.357642 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00035694300004252 future=<Future at 0x72e27c28d9a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.358131 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782442045.3571897, be25294a-11d9-453a-8fc1-9ffc77dbc4a7 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:40.358301 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.358562 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] VM Stopped (Lifecycle Event)
Jun 26 02:47:40.359521 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.28731085000003986 future=<Future at 0x72e27c28ee40 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.359651 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.28715607200001614 future=<Future at 0x72e27c28ee40 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.359730 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:40.376780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.956s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:40.377291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '753ab8b1-95f2-4a20-953f-4e7c0fe15161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:47:40.377720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:40.408243 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:40.408488 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:40.408660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '85')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:47:40.408759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '82')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:40.409738 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161', '83')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:47:40.410580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c3100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:47:40.410755 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:47:40.410964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Flush multipath device 33000000069322ad2 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:47:40.443611 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:47:40.444811 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:47:40.444811 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating image(s)
Jun 26 02:47:40.445070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:40.445189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:40.445675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:40.446129 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:40.449544 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:40.450970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:40.451535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:40.466606 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:40.507345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:47:40.548309 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:40.548820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:40.549329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:40.549926 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:40.553153 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:40.553489 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:40.568986 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:47:40.569310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:47:40.571006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:47:40.585893 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-045e87d0-b2d7-44bc-87c9-157974cf48ac tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: d3ee0b17-0238-4c17-b36d-5cc6e0e09dcb] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:40.586335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:47:40.587270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:47:40.601294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.639380 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.40.100,3260]
Jun 26 02:47:40.639380 np0000003683 nova-compute[98991]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:40.639380 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.646661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:40.647165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:40.673386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.693019 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.712243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk 1073741824" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:40.712843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:40.713244 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:40.738454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.50.100,3260]
Jun 26 02:47:40.738454 np0000003683 nova-compute[98991]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-753ab8b1-95f2-4a20-953f-4e7c0fe15161, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:40.738454 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.753926 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:40.754650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:40.754846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] <== disconnect_volume: return (2334ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:40.755081 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:47:40.808598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:40.808598 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:47:40.808598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:40.862736 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-732f9be7-dafc-4c52-b005-53a39d1e300c tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: be25294a-11d9-453a-8fc1-9ffc77dbc4a7] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:40.898121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:40.900760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:40.901097 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Cannot resize image /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:47:40.901421 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:47:40.901600 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Ensure instance console log exists: /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:47:40.901853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:40.902031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:40.902150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:40.972332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f90676e8-52ed-4850-84fd-f5b0bc5f4026 req-331d4456-c947-4422-850d-02666699f9a8 service nova] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:40.972969 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:40.973214 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:41.309904 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'flavor' on Instance uuid f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:41.562254 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:41.740809 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:41.867657 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:41.868055 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:41.912259 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:41.952407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.316637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-092dfb80-ab47-43a3-9bd9-c1957275a4ea tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.998s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:42.373347 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:42.414502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:42.414842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance network_info: |[{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:47:42.416853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start _get_guest_xml network_info=[{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:47:42.420109 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:42.421614 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1484249249', uuid='e6978931-a3e5-47b1-8d77-29481b046155'), owner=OwnerMeta(userid='b7340727e31547a4b39299401535770d', username='tempest-AttachVolumeShelveTestJSON-100564320-project-member', projectid='8a7eadbb081143fb8f96d0187a0f7c09', projectname='tempest-AttachVolumeShelveTestJSON-100564320'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442062.4211547) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:47:42.423650 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:47:42.424172 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:47:42.425285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:47:42.425668 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:47:42.426617 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:47:42.426945 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:47:42.427262 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:47:42.427548 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:47:42.427707 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:47:42.427831 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:47:42.427967 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:47:42.428186 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:47:42.428410 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:47:42.428950 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:47:42.429107 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:47:42.429300 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:47:42.447531 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYfQJzr8ZsXiFl/EGHeKsNky0xLWQG/tyV8JJtHK7MYw0OaU8uuBbIk7xVbmqScqG/XZgEHZae++Bzuk+oUSgVtdwYusj+0+YYRFY9VieKYGtvXjSHf7bu2FCrnZeVkg==',key_name='tempest-keypair-111261166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:47:42.447531 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:42.447531 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:42.447797 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_devices' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:42.846953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:42.847146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:42.847336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:42.847522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:42.847629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:42.849465 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Terminating instance
Jun 26 02:47:42.881800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.582s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:42.882159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <uuid>e6978931-a3e5-47b1-8d77-29481b046155</uuid>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <name>instance-0000002a</name>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1484249249</nova:name>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:47:42</nova:creationTime>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:user uuid="b7340727e31547a4b39299401535770d">tempest-AttachVolumeShelveTestJSON-100564320-project-member</nova:user>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:project uuid="8a7eadbb081143fb8f96d0187a0f7c09">tempest-AttachVolumeShelveTestJSON-100564320</nova:project>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         <nova:port uuid="389ac5ac-04ef-4796-b021-984e9d1f73cd">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="serial">e6978931-a3e5-47b1-8d77-29481b046155</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="uuid">e6978931-a3e5-47b1-8d77-29481b046155</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:41:f9:6f"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <target dev="tap389ac5ac-04"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/console.log" append="off"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:47:42.950466 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Preparing to wait for external event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYfQJzr8ZsXiFl/EGHeKsNky0xLWQG/tyV8JJtHK7MYw0OaU8uuBbIk7xVbmqScqG/XZgEHZae++Bzuk+oUSgVtdwYusj+0+YYRFY9VieKYGtvXjSHf7bu2FCrnZeVkg==',key_name='tempest-keypair-111261166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:42.952602 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:42.953555 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:47:42.954216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.954529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:42.954771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:47:42.955792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.955945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd292536-b97b-52e2-90d8-16dcd9df377b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:42.957029 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.957872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:42.960970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.961242 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap389ac5ac-04, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:42.961675 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap389ac5ac-04, col_values=(('qos', UUID('f420dae7-a1bb-433e-9c7b-0f5415f4a77f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:42.961879 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap389ac5ac-04, col_values=(('external_ids', {'iface-id': '389ac5ac-04ef-4796-b021-984e9d1f73cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f9:6f', 'vm-uuid': 'e6978931-a3e5-47b1-8d77-29481b046155'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:42.962903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.964216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:42.969498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:42.970659 np0000003683 nova-compute[98991]: INFO os_vif [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04')
Jun 26 02:47:43.352595 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:47:43.382054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:43.384456 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:43.388403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:47:43.388403 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:47:43.388403 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:43.388403 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:43.412768 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:43.417444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:43.449941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:43.495641 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:47:43.564101 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:43.564289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:43.564463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:43.564598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:43.564708 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] No waiting events found dispatching network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:43.564866 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-147ae9cf-147f-474a-a630-d67ea6b3b5bf req-af8588d3-caaa-4aee-8bea-d338ff678e0e service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:47:43.686222 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999734836999778 future=<Future at 0x72e27c423890 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:43.686689 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999267256999929 future=<Future at 0x72e27c423890 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:43.686817 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999101227999972 future=<Future at 0x72e27c423890 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:43.688570 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Instance destroyed successfully.
Jun 26 02:47:43.689064 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lazy-loading 'resources' on Instance uuid f209d7e5-1a71-4b80-9b35-f05f0f860265 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:43.898067 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:47:44.060293 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Successfully created port: c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:47:44.191407 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1746326085',display_name='tempest-AttachVolumeNegativeTest-server-1746326085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumenegativetest-server-1746326085',id=39,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr+10TGcqnWDjqhSHFtJoiBawO/eBjzZG6zagpsPo+7mgAlDLUX7CydYZu/btFxr+NgAgNAexCWrmREWNlExbs6XQyP3UASjVqVGmbw1VXntsdFQaPei2rolzlWR/p4mw==',key_name='tempest-keypair-1750468069',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:46Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94375dca8764ff8b335b461730d4cdb',ramdisk_id='',reservation_id='r-0cpu3rv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-918921231',owner_user_name='tempest-AttachVolumeNegativeTest-918921231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a74f26e27346dc9badc9eb4476dfa1',uuid=f209d7e5-1a71-4b80-9b35-f05f0f860265,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:47:44.191668 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converting VIF {"id": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "address": "fa:16:3e:f5:5c:00", "network": {"id": "d23a9948-ea77-4dc8-8385-df1d4fbb1418", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-594066865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a94375dca8764ff8b335b461730d4cdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7030d40-0a", "ovs_interfaceid": "f7030d40-0a10-4e26-9877-5cbaafb7e172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:44.192078 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:44.192258 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:47:44.194428 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.194763 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7030d40-0a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:44.197798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.199099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:44.203126 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.205089 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.205319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94d4a2d3-eb47-4127-8570-29dab5b7358a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:44.206444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.208776 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:44.212590 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:44.214659 np0000003683 nova-compute[98991]: INFO os_vif [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=f7030d40-0a10-4e26-9877-5cbaafb7e172,network=Network(d23a9948-ea77-4dc8-8385-df1d4fbb1418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7030d40-0a')
Jun 26 02:47:44.214948 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Deleting instance files /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265_del
Jun 26 02:47:44.215751 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Deletion of /opt/stack/data/nova/instances/f209d7e5-1a71-4b80-9b35-f05f0f860265_del complete
Jun 26 02:47:44.400880 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:47:44.493325 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:44.493564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:44.493735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No VIF found with MAC fa:16:3e:41:f9:6f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:44.494283 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Using config drive
Jun 26 02:47:44.579419 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Successfully updated port: c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:47:44.724895 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:47:44.727391 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:47:44.727905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:47:44.728058 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:47:44.728338 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:44.858164 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:45.005601 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:45.084739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:45.084739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:45.084739 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:45.168539 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating config drive at /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config
Jun 26 02:47:45.182395 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpetnc1ihe {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.244900 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpetnc1ihe" returned: 0 in 0.062s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.345608 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:45.345799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 26 02:47:45.414252 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:47:45.415448 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:47:45.415738 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Creating image(s)
Jun 26 02:47:45.416225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.416521 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.416913 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:45.417536 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:45.420002 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:45.423414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.492446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.492750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.508209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.508553 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.508911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.509568 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:45.513253 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:47:45.513655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.616968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.620103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.662727 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:45.663071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Acquiring lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.663301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.663505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:45.665511 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] No waiting events found dispatching network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:45.665684 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-unplugged-f7030d40-0a10-4e26-9877-5cbaafb7e172 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:47:45.665795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:45.665899 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing instance network info cache due to event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:45.666029 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:45.681188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk 1073741824" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.681362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:45.681700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.715192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:45.720743 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:45.757308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:45.805950 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.124s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.806437 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:47:45.806767 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:45.845335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:45.849435 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:45.853611 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] There are 0 instances to clean {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 26 02:47:45.855545 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:45.928955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f1dd4d91-7c4e-4fa1-8530-44ec547ba727 req-59a36c4d-fcbc-440f-918c-cb89b772cd35 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:45.929413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f1dd4d91-7c4e-4fa1-8530-44ec547ba727 req-59a36c4d-fcbc-440f-918c-cb89b772cd35 service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.929872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f1dd4d91-7c4e-4fa1-8530-44ec547ba727 req-59a36c4d-fcbc-440f-918c-cb89b772cd35 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.930015 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f1dd4d91-7c4e-4fa1-8530-44ec547ba727 req-59a36c4d-fcbc-440f-918c-cb89b772cd35 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:45.930952 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f1dd4d91-7c4e-4fa1-8530-44ec547ba727 req-59a36c4d-fcbc-440f-918c-cb89b772cd35 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Processing event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:47:45.930952 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:45.930952 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:47:45.932614 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:47:45.932614 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Ensure instance console log exists: /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:47:45.932614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:45.932614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:45.932614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:45.957267 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:46.002602 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:47:46.079033 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:46.082573 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:46.085416 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:46.091889 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:46.115559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:46.132010 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:46.355822 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Took 1.63 seconds to deallocate network for instance.
Jun 26 02:47:46.358047 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:47:46.535203 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442066.5345523, e6978931-a3e5-47b1-8d77-29481b046155 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:46.535203 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Started (Lifecycle Event)
Jun 26 02:47:46.537826 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:47:46.541266 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:47:46.544286 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance spawned successfully.
Jun 26 02:47:46.544682 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:47:46.551293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:46.551752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:46.555529 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:47:46.555847 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Claim successful on node np0000003683
Jun 26 02:47:46.633784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:46.634064 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance network_info: |[{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:47:46.634525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:46.636286 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start _get_guest_xml network_info=[{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:47:46.636520 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:46.639110 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:46.640340 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='2f7efbb6-021e-4bc3-a514-f21f96d3ff29'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442066.6399508) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:47:46.641500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:47:46.641844 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:47:46.642789 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:47:46.643086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:47:46.643957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:47:46.644236 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:47:46.644443 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:47:46.644582 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:47:46.645535 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:47:46.645762 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:47:46.646167 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:47:46.646428 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:47:46.646552 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:47:46.646716 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:47:46.646865 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:47:46.647118 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:47:46.662433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:47:46.662858 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:46.663451 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:46.663972 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:46.862569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:46.951997 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.041842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:47.044172 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:47.051866 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.052078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.052449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.052728 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.053053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.053365 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:47.138534 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <uuid>2f7efbb6-021e-4bc3-a514-f21f96d3ff29</uuid>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <name>instance-0000002b</name>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-0</nova:name>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:47:46</nova:creationTime>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         <nova:port uuid="c7cfe23d-16e2-4912-8b79-2d44cb60e8c5">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="serial">2f7efbb6-021e-4bc3-a514-f21f96d3ff29</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="uuid">2f7efbb6-021e-4bc3-a514-f21f96d3ff29</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:a6:ed:f4"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <target dev="tapc7cfe23d-16"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/console.log" append="off"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:47:47.166504 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Preparing to wait for external event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:47.168430 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:47:47.171580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.171580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:47.171580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:47:47.172553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.173126 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8249224c-7e59-5aa1-8d51-33484ef2a36a', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:47.174077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.174850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:47.175385 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.177829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.178073 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7cfe23d-16, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:47.178520 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7cfe23d-16, col_values=(('qos', UUID('194280c0-c825-4257-a3fd-f4822fe52e9e')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:47.178761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7cfe23d-16, col_values=(('external_ids', {'iface-id': 'c7cfe23d-16e2-4912-8b79-2d44cb60e8c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:ed:f4', 'vm-uuid': '2f7efbb6-021e-4bc3-a514-f21f96d3ff29'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:47.179733 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.180968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:47.185621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:47.186669 np0000003683 nova-compute[98991]: INFO os_vif [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16')
Jun 26 02:47:47.441955 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:47.546491 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:47:47.547146 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442067.5468822, e6978931-a3e5-47b1-8d77-29481b046155 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:47.547341 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Paused (Lifecycle Event)
Jun 26 02:47:47.557869 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Took 7.11 seconds to spawn the instance on the hypervisor.
Jun 26 02:47:47.558018 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:47.569659 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updated VIF entry in instance network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:47.569659 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:47.996760 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:47.997985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:47.997985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:47.997985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:47.998102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] No waiting events found dispatching network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:47.998179 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-81e355de-5d0b-4c40-b7c6-08bdf0cda0ae req-d5d06a99-bbcd-4e32-9f38-6b2ae79caa3e service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received unexpected event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd for instance with vm_state active and task_state None.
Jun 26 02:47:48.050829 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:48.053887 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442068.052684, e6978931-a3e5-47b1-8d77-29481b046155 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:48.053887 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Resumed (Lifecycle Event)
Jun 26 02:47:48.071729 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:48.075737 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Received event network-vif-deleted-f7030d40-0a10-4e26-9877-5cbaafb7e172 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:48.075737 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Neutron deleted interface f7030d40-0a10-4e26-9877-5cbaafb7e172; detaching it from the instance and deleting it from the info cache
Jun 26 02:47:48.076429 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Took 12.76 seconds to build instance.
Jun 26 02:47:48.077490 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-92bbb897-2d25-4eee-91ef-dbad656bca6a req-7f16f4f9-da0c-47b4-ab75-ccdf991b124c service nova] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Detach interface failed, port_id=f7030d40-0a10-4e26-9877-5cbaafb7e172, reason: Instance f209d7e5-1a71-4b80-9b35-f05f0f860265 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:47:48.158988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:48.159250 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:48.555285 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:48.557206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:48.580513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f49a6145-3dfa-4655-870e-fac9c66d9e00 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.267s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:48.664893 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:48.704263 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:48.704739 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:48.704945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:a6:ed:f4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:48.705499 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Using config drive
Jun 26 02:47:49.174250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.622s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:49.174856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.312s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:49.175044 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:47:49.212181 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:49.357207 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:49.360592 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:49.361130 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Creating config drive at /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config
Jun 26 02:47:49.366211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptckq7qz1 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:49.423665 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptckq7qz1" returned: 0 in 0.057s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:49.684650 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:47:49.685441 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:47:49.685872 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:49.686138 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:49.770493 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92d1888271c9461994f3d8303bb1943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f9aa2fcf774b1f83232b3613d4c444', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:47:49.842419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:49.842767 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:49.900620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:49.912302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:49.913766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:49.937191 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:50.016633 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:50.068169 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:50.069277 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing instance network info cache due to event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:50.069277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:50.069277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:50.069540 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:50.086308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:50.087437 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:50.188781 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:47:50.341711 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Successfully created port: 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:47:50.345931 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:50.571389 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:50.677752 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442070.6773124, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:50.677955 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Started (Lifecycle Event)
Jun 26 02:47:50.695905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:47:50.853445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.679s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:50.855218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.956s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:50.855284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:50.855998 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:47:50.915390 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Deleted allocations for instance f209d7e5-1a71-4b80-9b35-f05f0f860265
Jun 26 02:47:50.930428 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Successfully updated port: 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:47:50.941801 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:50.977797 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:50.977933 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing instance network info cache due to event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:50.978071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:50.978146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:50.978250 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:51.073248 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updated VIF entry in instance network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:51.073667 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:51.107785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:51.107785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:51.180935 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:51.182625 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442071.182408, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:51.182752 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Paused (Lifecycle Event)
Jun 26 02:47:51.200014 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Booting with volume 86546ce9-7ea0-4194-a7e8-e2ad73495e33 at /dev/vda
Jun 26 02:47:51.232020 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:51.242078 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:51.260096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:51.300640 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:51.300942 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:51.308209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:51.310036 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe59:92d4', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4'] 
Jun 26 02:47:51.310181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:51.310353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:51.310635 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:51.310877 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating existing volume attachment record: 027a8b2e-d996-4ce6-bcdf-09cf64caa7be {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:51.433148 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:51.481697 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:51.550553 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:51.575885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-15b05f24-3eba-46d0-91ff-b0b9c054c73d req-07fa64b9-176f-41e6-8a28-057be29823d1 service nova] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:51.612718 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:51.684843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:51.687599 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:51.692082 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:51.905945 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:51.931314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6896038-c18e-4b74-a4d7-f9b9a6724c87 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Lock "f209d7e5-1a71-4b80-9b35-f05f0f860265" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.084s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:51.954917 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:51.995125 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:51.995837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.082699 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.089416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:47:52.090940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.163641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:52.163884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:52.164112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:52.164287 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:52.164466 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Processing event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:47:52.164657 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:52.164830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:52.165027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:52.165109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:52.168079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:47:52.168079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:47:52.168079 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a0750075-a65c-43bf-9316-12f41f72cb7b req-ceb7c419-5b6e-4074-8570-350efd8c54c5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received unexpected event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with vm_state building and task_state spawning.
Jun 26 02:47:52.171369 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:47:52.174036 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance spawned successfully.
Jun 26 02:47:52.175625 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:47:52.183018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.183464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.199689 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:47:52.200558 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:52.204512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-93319c4c-7eef-449c-979a-5b174ee820e1 req-6c8c94b2-0372-47f1-b0f1-5f6e22d4ea19 service nova] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:52.207102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:52.208273 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442072.207593, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:52.208727 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:47:52.211169 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Resumed (Lifecycle Event)
Jun 26 02:47:52.289906 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.290611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:47:52.296929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.393667 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.394422 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.482660 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk.rescue --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.483245 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.566043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.566827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.622930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:52.655495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.659398 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.691540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.691540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.691540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.691540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.691540 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.692069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:47:52.716974 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:52.719618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:47:52.748659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.749132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.794862 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:47:52.836760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.840912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:52.930876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:52.931299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.020415 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:53.032661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.037412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.136159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.136721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.205300 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Took 7.79 seconds to spawn the instance on the hypervisor.
Jun 26 02:47:53.205648 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:53.222553 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:47:53.238967 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:53.239933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.246102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.353988 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.354742 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.430910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:47:53.432825 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:47:53.433120 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Creating image(s)
Jun 26 02:47:53.433474 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:47:53.433665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Ensure instance console log exists: /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:47:53.434014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:53.434296 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:53.434487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:53.453934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.458194 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.551335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.552846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.648101 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.652315 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:53.653584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.705870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:47:53.706324 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=49491MB free_disk=73.42266845703125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:47:53.706975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:53.706975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:53.719243 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Took 13.47 seconds to build instance.
Jun 26 02:47:53.736823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:53.737047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:53.737281 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Attaching volume ddde921d-b995-4930-99ab-7c5263e982bc to /dev/vdb
Jun 26 02:47:53.742677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:53.743059 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance network_info: |[{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:47:53.745317 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Start _get_guest_xml network_info=[{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '027a8b2e-d996-4ce6-bcdf-09cf64caa7be', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b791619a-facd-4781-a2c8-84641e233b95', 'attached_at': '', 'detached_at': '', 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'serial': '86546ce9-7ea0-4194-a7e8-e2ad73495e33'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:47:53.748981 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:47:53.751198 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1644809082', uuid='b791619a-facd-4781-a2c8-84641e233b95'), owner=OwnerMeta(userid='92d1888271c9461994f3d8303bb1943d', username='tempest-TestInstancesWithCinderVolumes-722025130-project-member', projectid='b8f9aa2fcf774b1f83232b3613d4c444', projectname='tempest-TestInstancesWithCinderVolumes-722025130'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442073.750679) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:47:53.756195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:47:53.756920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:47:53.758168 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:47:53.758271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:47:53.759602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:47:53.760807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:47:53.760807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:47:53.760807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:47:53.760807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:47:53.761181 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:47:53.762061 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:47:53.762310 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:47:53.762512 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:47:53.762697 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:47:53.762898 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:47:53.763969 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:47:53.781624 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:53.781952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:53.782392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:53.782748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:53.783079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:53.786621 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:53.798212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:53.800505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:53.800505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:53.800641 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:53.801211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:47:53.806189 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:53.806729 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:53.816265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:53.816265 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:53.822557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:53.822557 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33] added
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:53.834581 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:53.834829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:53.835011 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:53.835163 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:53.836632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33] added
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:53.854187 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:53.854535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:53.856029 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0489(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:53.856330 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:53.877623 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:47:53.877868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:47:53.886345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:47:53.887799 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe59:92d4', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea1:c108', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4'] 
Jun 26 02:47:53.887976 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:47:53.888111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:47:53.888414 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:53.888695 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updating existing volume attachment record: 097a0673-362b-48cb-8ad7-9f26b21e5bd5 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:47:54.229634 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.983s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:54.487711 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '46ef890d-4bdc-419c-b393-b2f4bb5651d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'serial': 'ddde921d-b995-4930-99ab-7c5263e982bc'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:47:54.490820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:47:54.491281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:47:54.491522 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:54.805304 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 121ec5e6-08cf-4e0c-9c89-e2be23a274be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.805495 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 266d20a5-b882-4896-9d47-a60855b80312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.807793 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.807962 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 35615762-25e8-4ae1-98b8-c0dd0083e709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.808494 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.808613 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 438d9a42-bd81-4489-8c87-68f146dfc61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.808707 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.808794 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance e6978931-a3e5-47b1-8d77-29481b046155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.808885 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.809326 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance b791619a-facd-4781-a2c8-84641e233b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:47:54.809617 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:47:54.809746 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:47:53 up 34 min,  2 users,  load average: 7.63, 6.63, 3.78\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_d2b07c33d4ed466ca32fa63a7e8b74e4': '3', 'io_workload': '1', 'num_vm_rescued': '1', 'num_proj_f2b74afe940c40d490cd930d9056fc92': '4', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_proj_8a7eadbb081143fb8f96d0187a0f7c09': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_b8f9aa2fcf774b1f83232b3613d4c444': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:47:54.835680 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:54.849847 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.858704 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:54.869451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:54.883096 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.890710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.890710 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.890710 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.890710 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.890710 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:54.899720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.899720 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.899720 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.899720 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.899720 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:54.903603 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.921353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.921353 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.921353 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.921353 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.921353 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:54.921587 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.921587 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.921587 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.921587 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.921587 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:54.941717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.40.100,3260]
Jun 26 02:47:54.941717 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:54.941717 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.958306 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.969539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.50.100,3260]
Jun 26 02:47:54.969539 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:54.969539 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.986246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:54.987000 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:54.987207 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:54.987659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:54.987951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:54.988810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('7', '-', '-', 0) found on session 86 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:54.988950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:55.005147 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:55.005586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:55.005843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:55.006880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('8', '-', '-', 0) found on session 87 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:55.006972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:55.025863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 86 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:55.025863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:55.025863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 87 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:55.025863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:55.331286 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:55.331793 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing instance network info cache due to event network-changed-cb535a56-d9b1-4193-bbaf-14a54d385198. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:55.334471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] Acquiring lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:55.334979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] Acquired lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:55.335148 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Refreshing network info cache for port cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:55.457032 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:55.457720 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:55.814275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:55.838205 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:55.961160 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updated VIF entry in instance network info cache for port cb535a56-d9b1-4193-bbaf-14a54d385198. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating instance_info_cache with network_info: [{"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.763s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98991) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:56.793051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:56.829518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found WWN 3300000002090850c for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:56.829954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:56.829954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '3300000002090850c', 'path': '/dev/dm-0', 'multipath_id': '3300000002090850c'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:56.829954 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002090850c', 'path': '/dev/dm-0', 'multipath_id': '3300000002090850c'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:56.832253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.340s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:56.832989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:47:56.848220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:56.849119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:47:56.850347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:56.850347 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:56.851077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:47:56.851077 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:56.870352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:56.870352 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:56.885516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:47:56.885516 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc] added
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:56.893999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:56.894623 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:56.894623 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc] added
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:47:56.899120 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:56.899421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:47:56.899962 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0489(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:47:56.899962 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:47:56.905732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b8d12a0-9d74-414b-b221-0f13f2a37ea5 req-4a070c73-6094-4058-8b59-4a28c4e7f737 service nova] Releasing lock "refresh_cache-438d9a42-bd81-4489-8c87-68f146dfc61b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:56.956544 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:56.972670 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.98 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:47:57.202625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.286808 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:47:57.337714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1644809082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testinstanceswithcindervolumes-server-1644809082',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4aEtpswIY5sjfsQeCuY2gAUydzm7Q1NmgN9uh8iVObzT5Sy23esrp/oKaxgSH1qqjYDHiyias2uTN5ibJs1yBdexmKsEUPjkF/Gl8WEfn3OSx9bg73g+5TuybbvDoBMw==',key_name='tempest-TestInstancesWithCinderVolumes-379047694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f9aa2fcf774b1f83232b3613d4c444',ramdisk_id='',reservation_id='r-nv4keuk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-722025130',owner_user_name='tempest-TestInstancesWithCinderVolumes-722025130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:51Z,user_data=None,user_id='92d1888271c9461994f3d8303bb1943d',uuid=b791619a-facd-4781-a2c8-84641e233b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:47:57.337960 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converting VIF {"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:57.338697 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:57.339522 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'pci_devices' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:47:57.419064 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:47:57.419385 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing instance network info cache due to event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:47:57.419494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:47:57.419641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:47:57.419784 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:47:57.773240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <uuid>b791619a-facd-4781-a2c8-84641e233b95</uuid>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <name>instance-0000002c</name>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1644809082</nova:name>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:47:53</nova:creationTime>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:user uuid="92d1888271c9461994f3d8303bb1943d">tempest-TestInstancesWithCinderVolumes-722025130-project-member</nova:user>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:project uuid="b8f9aa2fcf774b1f83232b3613d4c444">tempest-TestInstancesWithCinderVolumes-722025130</nova:project>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         <nova:port uuid="077e020c-fd5b-49cf-9804-87f57efbd930">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="serial">b791619a-facd-4781-a2c8-84641e233b95</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="uuid">b791619a-facd-4781-a2c8-84641e233b95</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/disk.config"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <alias name="ua-86546ce9-7ea0-4194-a7e8-e2ad73495e33"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <serial>86546ce9-7ea0-4194-a7e8-e2ad73495e33</serial>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:07:6d:30"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <target dev="tap077e020c-fd"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/console.log" append="off"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Preparing to wait for external event network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:47:57.846646 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1644809082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testinstanceswithcindervolumes-server-1644809082',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4aEtpswIY5sjfsQeCuY2gAUydzm7Q1NmgN9uh8iVObzT5Sy23esrp/oKaxgSH1qqjYDHiyias2uTN5ibJs1yBdexmKsEUPjkF/Gl8WEfn3OSx9bg73g+5TuybbvDoBMw==',key_name='tempest-TestInstancesWithCinderVolumes-379047694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8f9aa2fcf774b1f83232b3613d4c444',ramdisk_id='',reservation_id='r-nv4keuk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-722025130',owner_user_name='tempest-TestInstancesWithCinderVolumes-722025130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:47:51Z,user_data=None,user_id='92d1888271c9461994f3d8303bb1943d',uuid=b791619a-facd-4781-a2c8-84641e233b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converting VIF {"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:57.851283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:47:57.853931 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.853931 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8266403-376e-53d5-9af9-3feeab5edb60', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:57.855572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.856988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:57.856988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.859495 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.859701 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap077e020c-fd, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:57.860084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap077e020c-fd, col_values=(('qos', UUID('ee51bdfc-f575-4cfe-8b77-d1aa2deb9ffa')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:57.860288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap077e020c-fd, col_values=(('external_ids', {'iface-id': '077e020c-fd5b-49cf-9804-87f57efbd930', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:6d:30', 'vm-uuid': 'b791619a-facd-4781-a2c8-84641e233b95'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:47:57.861463 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.863547 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:47:57.867661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:47:57.867870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:47:57.869078 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:57.870371 np0000003683 nova-compute[98991]: INFO os_vif [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd')
Jun 26 02:47:57.873395 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:47:57.873588 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Claim successful on node np0000003683
Jun 26 02:47:57.894582 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:47:57.900130 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:57.908252 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:47:57.919779 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:57.923676 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:57.927251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:57.935851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.943975 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.944231 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.954036 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:57.954325 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:57.955902 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.956248 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.956467 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.956607 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.956878 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.957036 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.957216 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:47:57.957318 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:47:57.957998 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 19.24 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:47:57.985501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.50.100,3260]
Jun 26 02:47:57.985501 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.50.100,3260] successful.
Jun 26 02:47:57.985501 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:58.002664 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:58.011130 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.40.100,3260]
Jun 26 02:47:58.011130 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.40.100,3260] successful.
Jun 26 02:47:58.011130 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.025132 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.025722 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:58.026792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:47:58.027192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:58.027399 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:58.028817 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('11', '-', '-', 0) found on session 88 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:58.028970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:58.050083 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 88 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:58.050344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.052269 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:47:58.052619 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:47:58.052763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:58.053710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:47:58.053757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('12', '-', '-', 0) found on session 89 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:47:58.053847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:47:58.079359 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:47:58.079359 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:47:58.331027 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:58.505634 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updated VIF entry in instance network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:47:58.505971 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:47:58.686407 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004234990001350525 future=<Future at 0x72e27c423890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:58.686562 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:47:58.686905 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Emitting event <LifecycleEvent: 1782442063.6858506, f209d7e5-1a71-4b80-9b35-f05f0f860265 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:47:58.687083 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] VM Stopped (Lifecycle Event)
Jun 26 02:47:58.851890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:47:59.008139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e96ae14d-0742-4695-b2ee-9b01a2faafc1 req-ee84f603-0497-4a6a-aa49-b29546c52ee5 service nova] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:47:59.128380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:47:59.191536 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: f209d7e5-1a71-4b80-9b35-f05f0f860265] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:47:59.389377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:59.389592 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:47:59.389808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No VIF found with MAC fa:16:3e:07:6d:30, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:47:59.390136 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Using config drive
Jun 26 02:47:59.526796 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:47:59.527229 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:47:59.871724 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 330000000bf2e03f7 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:47:59.872173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:47:59.874227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (5382ms) {'type': 'block', 'scsi_wwn': '330000000bf2e03f7', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000bf2e03f7'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:47:59.874460 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf2e03f7', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000bf2e03f7'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:47:59.878159 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:47:59.878542 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:47:59.878702 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:47:59.879660 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x72e29c20a3f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '46ef890d-4bdc-419c-b393-b2f4bb5651d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'serial': 'ddde921d-b995-4930-99ab-7c5263e982bc'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:47:59.879759 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98991) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 26 02:47:59.880894 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] opening encrypted volume /dev/dm-4 {{(pid=98991) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 26 02:47:59.895501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:47:59.926839 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:47:59.926839 np0000003683 nova-compute[98991]: INFO os_brick.encryptors.luks [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] /dev/dm-4 is not a valid LUKS device; formatting device for first use
Jun 26 02:47:59.926839 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:48:00.030812 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:00.108277 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Creating config drive at /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/disk.config
Jun 26 02:48:00.111741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2zr9j2kh {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:00.166648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2zr9j2kh" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:00.539183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.671s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:00.540370 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:48:00.615403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:00.649239 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:00.735709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:00.934887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:01.002262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:01.016080 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:01.028470 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:01.043788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:01.051939 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:48:01.053119 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:48:01.053574 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:01.054793 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:01.160550 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:48:01.557541 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:48:01.699663 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442081.699082, b791619a-facd-4781-a2c8-84641e233b95 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:01.699982 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] VM Started (Lifecycle Event)
Jun 26 02:48:01.762061 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Successfully created port: e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:48:01.964074 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:02.065412 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:48:02.203528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:02.212343 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442082.212001, b791619a-facd-4781-a2c8-84641e233b95 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:02.212500 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] VM Paused (Lifecycle Event)
Jun 26 02:48:02.579987 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Successfully updated port: e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:48:02.658567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:02.658567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing instance network info cache due to event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:02.658792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:02.659005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:02.660102 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:02.718415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:02.725443 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:02.863621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:03.083936 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:48:03.085754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:03.086100 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:48:03.086615 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Creating image(s)
Jun 26 02:48:03.087424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:03.087773 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:03.088391 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:03.089202 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:03.093225 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:03.097502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:03.219424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.124s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:03.222123 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:03.226469 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:03.227728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:03.228433 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:03.232258 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:03.232943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:03.252632 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:03.328076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:03.339759 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:03.342402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:03.400615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk 1073741824" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:03.402498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:03.402498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:03.506873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:03.510508 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:48:03.510508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:03.534894 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:03.603328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:03.605499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:04.042975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da020863-997b-404f-942f-c40c1fe044c8 req-37b1b02e-2e45-4dd5-996c-2c7ce7c35676 service nova] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:04.043529 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:04.043683 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:04.678562 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:04.724570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:04.914808 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:05.130084 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:05.632713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:05.632994 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance network_info: |[{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:48:05.634463 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start _get_guest_xml network_info=[{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:05.643167 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:05.643167 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='f0c513bb-680e-44fa-a657-c22de6578b1b'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442085.642352) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:05.643914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:05.644251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:05.645173 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:05.645388 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:05.646426 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:05.646734 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:05.646909 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:05.646980 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:05.647064 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:05.647125 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:05.647264 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:05.647439 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:05.647552 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:05.647660 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:05.647754 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:05.647863 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:05.658766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:05.658996 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:05.661085 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:05.661085 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:05.797634 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:05.797634 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:05.992112 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] opening encrypted volume /dev/dm-4 {{(pid=98991) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 26 02:48:06.086528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-98253ee6-e15e-47bb-a64b-270fffa100cb req-6b7a5e42-2e94-4bf7-b46c-abdef62ac363 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:06.086528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98253ee6-e15e-47bb-a64b-270fffa100cb req-6b7a5e42-2e94-4bf7-b46c-abdef62ac363 service nova] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:06.088706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98253ee6-e15e-47bb-a64b-270fffa100cb req-6b7a5e42-2e94-4bf7-b46c-abdef62ac363 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:06.090143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-98253ee6-e15e-47bb-a64b-270fffa100cb req-6b7a5e42-2e94-4bf7-b46c-abdef62ac363 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:06.090143 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-98253ee6-e15e-47bb-a64b-270fffa100cb req-6b7a5e42-2e94-4bf7-b46c-abdef62ac363 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Processing event network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:48:06.091425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:48:06.096812 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442086.0962558, b791619a-facd-4781-a2c8-84641e233b95 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:06.097822 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:48:06.097822 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] VM Resumed (Lifecycle Event)
Jun 26 02:48:06.103182 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance spawned successfully.
Jun 26 02:48:06.103755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <uuid>f0c513bb-680e-44fa-a657-c22de6578b1b</uuid>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <name>instance-0000002d</name>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-1</nova:name>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:05</nova:creationTime>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         <nova:port uuid="e090a292-3a46-4777-8978-eb75d9b4e5df">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="serial">f0c513bb-680e-44fa-a657-c22de6578b1b</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="uuid">f0c513bb-680e-44fa-a657-c22de6578b1b</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:18:02:69"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <target dev="tape090a292-3a"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/console.log" append="off"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:06.185067 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Preparing to wait for external event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:06.187885 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:06.189716 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.190341 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:06.191299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:06.194074 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.194292 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '463fd289-bd7d-5ff4-ac10-6b7a5a7d9550', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:06.195066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.195866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:06.203877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.206168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.206168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape090a292-3a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:06.207607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape090a292-3a, col_values=(('qos', UUID('495a4973-c967-4999-a750-49d92f6b8f53')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:06.207607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape090a292-3a, col_values=(('external_ids', {'iface-id': 'e090a292-3a46-4777-8978-eb75d9b4e5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:02:69', 'vm-uuid': 'f0c513bb-680e-44fa-a657-c22de6578b1b'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:06.210192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.212638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:06.217547 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.218782 np0000003683 nova-compute[98991]: INFO os_vif [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a')
Jun 26 02:48:06.299830 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Detaching volume c7d73690-2ab9-452d-95f1-dce4a3fa8c02
Jun 26 02:48:06.379289 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Attempting to driver detach volume c7d73690-2ab9-452d-95f1-dce4a3fa8c02 from mountpoint /dev/vdb
Jun 26 02:48:06.384437 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Found disk vdb by alias ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:48:06.386057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Found disk vdb by alias ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:48:06.386126 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Attempting to detach device vdb from instance 35615762-25e8-4ae1-98b8-c0dd0083e709 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <alias name="ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02"/>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <serial>c7d73690-2ab9-452d-95f1-dce4a3fa8c02</serial>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:06.386430 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully detached device vdb from instance 35615762-25e8-4ae1-98b8-c0dd0083e709 from the persistent domain config.
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] (1/8): Attempting to detach device vdb with device alias ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 from instance 35615762-25e8-4ae1-98b8-c0dd0083e709 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <alias name="ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02"/>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <serial>c7d73690-2ab9-452d-95f1-dce4a3fa8c02</serial>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:06.400277 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:48:06.603542 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:06.615786 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:06.620621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.620621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.620621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.622212 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.622212 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.622212 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:06.705230 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:06.967836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:07.075748 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 for instance 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:48:07.118990 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: b791619a-facd-4781-a2c8-84641e233b95] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:07.121251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442087.1199615, 35615762-25e8-4ae1-98b8-c0dd0083e709 => ua-c7d73690-2ab9-452d-95f1-dce4a3fa8c02> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:48:07.123850 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully detached device vdb from instance 35615762-25e8-4ae1-98b8-c0dd0083e709 from the live domain config.
Jun 26 02:48:07.127020 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:48:07.128624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:07.129821 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:07.130345 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Took 13.70 seconds to spawn the instance on the hypervisor.
Jun 26 02:48:07.130633 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:07.645670 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Took 21.14 seconds to build instance.
Jun 26 02:48:07.721795 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:48:07.750414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:07.750591 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:07.750915 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:18:02:69, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:07.751269 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Using config drive
Jun 26 02:48:08.086408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.957s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:08.086921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:48:08.087076 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:08.129364 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:08.129808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '91')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:48:08.130198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '76')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:08.132210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02', '77')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:08.133381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4a4ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:48:08.133683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:48:08.133953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Flush multipath device 330000000a66ebc4c {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:48:08.147650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d31406fc-87d3-4b75-acc8-7317cba51bfd tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.654s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:08.166899 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:08.176087 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:08.185528 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:08.186837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:08.187952 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:08.188406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:08.188535 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] No waiting events found dispatching network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:08.188744 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received unexpected event network-vif-plugged-077e020c-fd5b-49cf-9804-87f57efbd930 for instance with vm_state active and task_state None.
Jun 26 02:48:08.188919 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:08.191191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:08.191191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:08.191191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:08.191191 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No event matching network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df in dict_keys([('network-vif-plugged', 'e090a292-3a46-4777-8978-eb75d9b4e5df')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:48:08.191191 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b04659d0-77a1-494d-9b37-933d68287fc2 req-39ed5bba-09f8-462a-be1e-815a880ce511 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state building and task_state spawning.
Jun 26 02:48:08.219105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:08.257675 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:08.259772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:48:08.259915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:48:08.262005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:48:08.278209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:48:08.278399 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:48:08.297027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.341792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.40.100,3260]
Jun 26 02:48:08.341792 np0000003683 nova-compute[98991]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:08.341792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.368812 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.380966 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.393018 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Creating config drive at /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config
Jun 26 02:48:08.396682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wgzt7wq {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:08.419435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.50.100,3260]
Jun 26 02:48:08.419435 np0000003683 nova-compute[98991]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c7d73690-2ab9-452d-95f1-dce4a3fa8c02, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:08.419435 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.437083 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:08.437829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:08.438031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] <== disconnect_volume: return (1308ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:08.438288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:48:08.460169 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wgzt7wq" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:08.670876 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Attempting to attach volume ddde921d-b995-4930-99ab-7c5263e982bc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:   <alias name="ua-ddde921d-b995-4930-99ab-7c5263e982bc"/>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:   <serial>ddde921d-b995-4930-99ab-7c5263e982bc</serial>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:08.674351 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:48:09.013313 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'flavor' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:09.083158 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:09.108764 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:09.114766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:09.206313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:09.269183 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:09.270829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:10.023163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0fadccf7-2624-4b2d-96e2-954c46834b47 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.226s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:10.045348 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442090.0447252, f0c513bb-680e-44fa-a657-c22de6578b1b => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:10.045557 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Started (Lifecycle Event)
Jun 26 02:48:10.248934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:10.249368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:10.249368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:10.249575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:10.249704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:10.253945 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Terminating instance
Jun 26 02:48:10.288778 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:10.289211 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing instance network info cache due to event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:10.289211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:10.289708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:10.289708 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:10.498269 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:10.498396 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:10.498504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:10.498623 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:59:92:d4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:10.550949 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:10.554099 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442090.5537386, f0c513bb-680e-44fa-a657-c22de6578b1b => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:10.554278 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Paused (Lifecycle Event)
Jun 26 02:48:10.757233 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:48:10.790538 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:10.794020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:10.800285 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:10.816218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:10.987772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:10.997429 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.057506 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:11.061447 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:11.063903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:11.064118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:11.064365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:11.068546 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:11.068546 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fed55771-e194-448a-94c7-7016a4b43ba5 req-99717564-2a15-4fc7-b288-137768e18ef0 service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:11.075902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:11.123564 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Instance destroyed successfully.
Jun 26 02:48:11.124114 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:11.138379 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:11.138558 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing instance network info cache due to event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:11.138734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:11.207369 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.259051 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:11.400764 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updated VIF entry in instance network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:11.401079 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:11.565340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:11.565647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:11.579944 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:11.580309 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999825855999916 future=<Future at 0x72e27c268fb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:11.580540 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999580479000088 future=<Future at 0x72e27c268fb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:11.580651 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999466547999873 future=<Future at 0x72e27c268fb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:11.628260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1868442542',display_name='tempest-ServerRescueNegativeTestJSON-server-1868442542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1868442542',id=37,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxXpYanSUxxppgp1pXTr0qK/foEs6Vexq2CEFusaauLeujVxHcSB/Hz60V9zNvS9YCHaUnUtLIyf+OPJHdoKAZfLWqHtvwi5YM/+jyGRBpbhXpEUKiyBoestMnqTVfoJw==',key_name='tempest-keypair-1387228019',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:22Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-zjie408o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=35615762-25e8-4ae1-98b8-c0dd0083e709,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:11.628560 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "address": "fa:16:3e:a1:c1:08", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd1b6c07-e3", "ovs_interfaceid": "cd1b6c07-e35a-4adb-a942-f1637c0b96a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:11.629159 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:11.629445 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:11.630844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.631195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd1b6c07-e3, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:11.632833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.633991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:11.634867 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.635560 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.635786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c652aea1-8bd8-41ab-8e89-66d46ae822ef) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:11.637070 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.637070 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:11.637888 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:11.640454 np0000003683 nova-compute[98991]: INFO os_vif [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c1:08,bridge_name='br-int',has_traffic_filtering=True,id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd1b6c07-e3')
Jun 26 02:48:11.640757 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Deleting instance files /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709_del
Jun 26 02:48:11.641459 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Deletion of /opt/stack/data/nova/instances/35615762-25e8-4ae1-98b8-c0dd0083e709_del complete
Jun 26 02:48:11.906304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:11.906304 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:11.906304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:11.906716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:11.906716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:11.907512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Processing event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:48:11.907512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:11.908002 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:11.908130 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:11.910190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:11.910190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:11.911839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:48:11.911839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:11.911839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:11.911839 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-26a57c05-c3e2-4b96-94ef-8a2c363fd2df req-be6c034f-32f7-4854-b480-09e706e1d8bd service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state building and task_state spawning.
Jun 26 02:48:11.915552 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442091.9146807, f0c513bb-680e-44fa-a657-c22de6578b1b => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:11.915552 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Resumed (Lifecycle Event)
Jun 26 02:48:11.917139 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:48:11.921929 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance spawned successfully.
Jun 26 02:48:11.921929 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:48:11.969287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:12.059728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f9d1608-392c-44f4-8443-6708f4182cb9 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.323s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:12.067696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:48:12.149999 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:48:12.150584 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:48:12.150910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:48:12.151058 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:48:12.151318 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:12.307570 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:12.411847 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:12.418986 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:12.420919 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:12.432613 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.432754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.433113 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.434643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.436167 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.436524 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:12.705517 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:12.705806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:12.876248 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-04438597-19f6-49e8-baf5-2a33ad4e22e2 req-a8ee4330-58c9-4292-b6ed-c5c70bb575cf service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-deleted-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:12.876581 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-04438597-19f6-49e8-baf5-2a33ad4e22e2 req-a8ee4330-58c9-4292-b6ed-c5c70bb575cf service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Neutron deleted interface cd1b6c07-e35a-4adb-a942-f1637c0b96a7; detaching it from the instance and deleting it from the info cache
Jun 26 02:48:12.878642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-04438597-19f6-49e8-baf5-2a33ad4e22e2 req-a8ee4330-58c9-4292-b6ed-c5c70bb575cf service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Detach interface failed, port_id=cd1b6c07-e35a-4adb-a942-f1637c0b96a7, reason: Instance 35615762-25e8-4ae1-98b8-c0dd0083e709 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:48:12.892423 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:12.896196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:12.896870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:12.901471 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:48:12.901610 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Claim successful on node np0000003683
Jun 26 02:48:12.923288 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:12.941168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Took 9.86 seconds to spawn the instance on the hypervisor.
Jun 26 02:48:12.941317 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:13.071703 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updated VIF entry in instance network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:13.072097 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] No waiting events found dispatching network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:13.154347 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-51f1f153-6ed5-48f2-9deb-4b65b07cc40b req-21ffdcf5-7292-4cf0-954c-965b9d73214c service nova] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Received event network-vif-unplugged-cd1b6c07-e35a-4adb-a942-f1637c0b96a7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:13.194261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:13.194463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:13.210579 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:48:13.327692 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:13.451360 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Took 15.66 seconds to build instance.
Jun 26 02:48:13.574536 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab9a9a2d-19e0-47d7-8b18-72cc07e6782e req-424cd744-7f2e-464e-a14e-714f1abbdf7e service nova] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:13.696908 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Detaching volume ddde921d-b995-4930-99ab-7c5263e982bc
Jun 26 02:48:13.750859 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Attempting to driver detach volume ddde921d-b995-4930-99ab-7c5263e982bc from mountpoint /dev/vdb
Jun 26 02:48:13.785017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:13.796394 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '46ef890d-4bdc-419c-b393-b2f4bb5651d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'serial': 'ddde921d-b995-4930-99ab-7c5263e982bc'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:48:13.800342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-ddde921d-b995-4930-99ab-7c5263e982bc {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:48:13.801669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-ddde921d-b995-4930-99ab-7c5263e982bc {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:48:13.801786 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Attempting to detach device vdb from instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <alias name="ua-ddde921d-b995-4930-99ab-7c5263e982bc"/>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <serial>ddde921d-b995-4930-99ab-7c5263e982bc</serial>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:13.802448 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:48:13.808975 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 from the persistent domain config.
Jun 26 02:48:13.809142 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] (1/8): Attempting to detach device vdb with device alias ua-ddde921d-b995-4930-99ab-7c5263e982bc from instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <alias name="ua-ddde921d-b995-4930-99ab-7c5263e982bc"/>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <serial>ddde921d-b995-4930-99ab-7c5263e982bc</serial>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:13.809389 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:48:13.829360 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Took 1.68 seconds to deallocate network for instance.
Jun 26 02:48:13.953364 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Refreshing inventories for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 26 02:48:13.955259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9113ed89-105f-48ca-a3d6-037d577e0510 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:14.000175 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Updating ProviderTree inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 26 02:48:14.000464 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:48:14.040896 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Refreshing aggregate associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, aggregates: None {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 26 02:48:14.097962 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Refreshing trait associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_RISCV64,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_LAN9118 {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 26 02:48:14.328036 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442094.3274648, 46ef890d-4bdc-419c-b393-b2f4bb5651d3 => ua-ddde921d-b995-4930-99ab-7c5263e982bc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:48:14.329363 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ddde921d-b995-4930-99ab-7c5263e982bc for instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:48:14.331717 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 from the live domain config.
Jun 26 02:48:14.333787 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:48:14.334037 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:48:14.334233 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:48:14.334895 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x72e29e7ab560>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '46ef890d-4bdc-419c-b393-b2f4bb5651d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'serial': 'ddde921d-b995-4930-99ab-7c5263e982bc'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:48:14.335035 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] closing encrypted volume /dev/dm-9 {{(pid=98991) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
Jun 26 02:48:14.336974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddde921d-b995-4930-99ab-7c5263e982bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:48:14.368504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:14.402201 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc (non-flash)
Jun 26 02:48:14.402453 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:14.402711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '89')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:48:14.402900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '89')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:14.404128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc', '88')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:14.408070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a1120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'): ({'sdf'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:48:14.408384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:48:14.408717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 330000000bf2e03f7 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:48:14.450013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:14.488920 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:14.489345 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing instance network info cache due to event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:14.489547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:14.489635 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:14.489743 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:14.502938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:14.559517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:48:14.559693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:48:14.560813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:48:14.572814 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:48:14.573009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:48:14.585462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.624012 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.40.100,3260]
Jun 26 02:48:14.624012 np0000003683 nova-compute[98991]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:14.624012 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.643054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.662758 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.697225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.50.100,3260]
Jun 26 02:48:14.697225 np0000003683 nova-compute[98991]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-ddde921d-b995-4930-99ab-7c5263e982bc, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:14.697225 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.715634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:14.718612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:14.718612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (350ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:14.718612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:48:14.796354 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:14.797774 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:14.994597 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:15.279596 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:15.302093 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:15.341416 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:15.511423 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updated VIF entry in instance network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:15.511719 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:15.809260 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.912s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:15.810272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.025s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:15.810525 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:48:15.818645 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:48:15.818847 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Claim successful on node np0000003683
Jun 26 02:48:16.018018 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-74f80cca-c5d9-4ea5-83a9-3c4ff1d5fa51 req-7db53167-0445-4737-8e15-7c94a1045577 service nova] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:16.177854 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:16.178096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:16.285738 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c192c4c7-8855-4136-a42e-f7fbc18794a2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.091s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:16.319531 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:48:16.319847 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:48:16.320134 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:16.320421 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:16.402065 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dabf44f7bd7d4f0bb60de94c0db9de53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addc661d189b4a8c8e130200e4d2c30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:48:16.513397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:16.513717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:16.513825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:16.513979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:16.514110 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:16.516079 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Terminating instance
Jun 26 02:48:16.565121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:16.565580 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing instance network info cache due to event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:16.565786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:16.565902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:16.566017 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:16.637286 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:16.681311 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:16.823744 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:48:16.912634 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Successfully created port: f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:48:16.972587 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.021236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:48:17.045147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.047736 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.068054 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:17.073615 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.076894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.107884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.107884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.195850 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:17.332739 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:48:17.367308 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999747230000139 future=<Future at 0x72e27c570d40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:17.373529 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Instance destroyed successfully.
Jun 26 02:48:17.374105 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'resources' on Instance uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:17.573631 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:17.686556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:17.701757 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] While synchronizing instance power states, found 13 instances in the database and 10 instances on the hypervisor.
Jun 26 02:48:17.701965 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.702557 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.703344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:17.703344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:17.703783 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid fbf319d1-e938-4727-8ed3-2275ec9bd8c2 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.704625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:17.705006 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.705412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "266d20a5-b882-4896-9d47-a60855b80312" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:17.705748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:17.706027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:17.706403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.709261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:17.709737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:17.712970 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 46ef890d-4bdc-419c-b393-b2f4bb5651d3 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.713613 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.714934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.718085 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.723073 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:17.723943 np0000003683 nova-compute[98991]: WARNING nova.utils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72e27c455bc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 26 02:48:17.724262 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.724688 np0000003683 nova-compute[98991]: WARNING nova.utils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72e27c455bc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 26 02:48:17.725042 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid ecba11d0-cb36-45bd-afce-8a4a2666c369 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.725199 np0000003683 nova-compute[98991]: WARNING nova.utils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72e27c455bc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 26 02:48:17.725771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:17.736641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 05f1b3fb-23f5-44a0-8598-1dc4be523f89 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.736641 np0000003683 nova-compute[98991]: WARNING nova.utils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72e27c455bc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 26 02:48:17.736641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 35615762-25e8-4ae1-98b8-c0dd0083e709 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:48:17.736641 np0000003683 nova-compute[98991]: WARNING nova.utils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72e27c455bc0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 26 02:48:17.737399 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.15 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:48:17.772353 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:17.772609 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:17.792083 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updated VIF entry in instance network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:17.794315 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Successfully updated port: f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:48:17.794904 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:17.839172 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Booting with volume 76e72eb2-642a-4440-b292-3986774c1094 at /dev/vda
Jun 26 02:48:17.881583 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2097260523',display_name='tempest-TestEncryptedCinderVolumes-server-2097260523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-2097260523',id=41,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhm+3ExH7tfL3QRb+nzxhH/cAYx7khoc3MWVMjUdWUPeaLTbIioWVFGNjAAu3YdB7FEU/XUN9csVtMN+/fYcuUxU9xN7DY8eLom8lVmCs/PcRFQj4guGpI8A/T4U97Z8w==',key_name='tempest-keypair-442487376',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-rqywmh32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=46ef890d-4bdc-419c-b393-b2f4bb5651d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:17.881583 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "155e390e-309d-47a6-8b62-70763a8d531a", "address": "fa:16:3e:59:92:d4", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap155e390e-30", "ovs_interfaceid": "155e390e-309d-47a6-8b62-70763a8d531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:17.882260 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:17.882870 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:17.884109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.884445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap155e390e-30, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:17.885642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.886894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:17.888435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.889726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.890009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=369efc90-d12a-4317-8eeb-c516e97a718b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:17.890607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.891144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:17.892631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:17.893491 np0000003683 nova-compute[98991]: INFO os_vif [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=155e390e-309d-47a6-8b62-70763a8d531a,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap155e390e-30')
Jun 26 02:48:17.893809 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Deleting instance files /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3_del
Jun 26 02:48:17.894821 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Deletion of /opt/stack/data/nova/instances/46ef890d-4bdc-419c-b393-b2f4bb5651d3_del complete
Jun 26 02:48:17.913960 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:17.928798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:17.953297 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:17.997684 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:17.997947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:18.008176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:18.009737 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:48:18.009939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:18.010136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:18.010428 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:18.011058 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updating existing volume attachment record: 573748db-d026-4f6c-80eb-beaceb08015a {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:48:18.210228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.210662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.221392 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "266d20a5-b882-4896-9d47-a60855b80312" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.516s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.222021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.222233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "e6978931-a3e5-47b1-8d77-29481b046155" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.224195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.224674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.227545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.240518 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.530s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.241894 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.241894 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.245839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.522s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.246036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.246200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.276052 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:18.297783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd0dba8b-9566-43f6-9958-d6113889b9d7 req-74826bca-bc85-4884-bef1-5ee4f23084a7 service nova] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:18.298629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:18.298779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquired lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:18.298986 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:18.408776 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:48:18.409493 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:48:18.409756 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:48:18.409876 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:48:18.410185 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:18.476513 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:18.655791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:18.656241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.656241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.656459 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.656910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] No waiting events found dispatching network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:18.657068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:18.657219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:18.657437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Acquiring lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.657630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.657781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.657936 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] No waiting events found dispatching network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:18.658108 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-unplugged-155e390e-309d-47a6-8b62-70763a8d531a for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:18.658261 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-changed-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:18.658430 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Refreshing instance network info cache due to event network-changed-f54efd61-0762-4cb1-9190-babcc576ccb0. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:18.658598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Acquiring lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:18.732831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "e6978931-a3e5-47b1-8d77-29481b046155" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.733124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.734298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.734653 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.746960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.747461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "35615762-25e8-4ae1-98b8-c0dd0083e709" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.750002 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.784899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.975s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:18.785435 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.448s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.786004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:48:18.791196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:18.792575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:18.792901 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attaching volume 30e69043-4f4b-47f3-b252-4718d5d2e28b to /dev/vdb
Jun 26 02:48:18.850766 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:18.861392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:18.887213 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:18.921017 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:18.933887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:18.934145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:18.944153 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:18.945639 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:48:18.945790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:18.945915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:18.946115 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:18.947966 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating existing volume attachment record: 685a1f18-3554-4159-81e7-a535ed70473c {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:48:19.065135 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37395442-968c-4cd8-afe8-a00bb3b1fa02 req-bf0f0493-bd36-4698-98ca-487a1262f64e service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Received event network-vif-deleted-155e390e-309d-47a6-8b62-70763a8d531a {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:19.065780 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-37395442-968c-4cd8-afe8-a00bb3b1fa02 req-bf0f0493-bd36-4698-98ca-487a1262f64e service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Neutron deleted interface 155e390e-309d-47a6-8b62-70763a8d531a; detaching it from the instance and deleting it from the info cache
Jun 26 02:48:19.068629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37395442-968c-4cd8-afe8-a00bb3b1fa02 req-bf0f0493-bd36-4698-98ca-487a1262f64e service nova] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Detach interface failed, port_id=155e390e-309d-47a6-8b62-70763a8d531a, reason: Instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:48:19.156647 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:19.301861 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:48:19.302092 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:48:19.302342 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:19.302826 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:19.354511 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updating instance_info_cache with network_info: [{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:19.460899 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cedb95c2c824de4a4094fbc0fb78818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e495387d164138b6b3789f33fdac7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:48:19.509534 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:19.517917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:19.518373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:19.518574 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:19.519061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:19.519350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:19.534659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:19.535991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:19.536240 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:19.536565 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:19.537718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:19.538148 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:19.551182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:19.551182 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:19.557967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:19.557967 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b] added
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:19.567221 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:19.567583 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:19.567751 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:19.567973 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b] added
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:19.572972 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:19.573158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:19.573341 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:19.573575 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:19.648193 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:19.648534 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:19.800135 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:48:19.857362 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Releasing lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:19.857362 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Instance network_info: |[{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:48:19.858143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Acquired lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:19.858570 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Refreshing network info cache for port f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:20.015060 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Took 1.61 seconds to deallocate network for instance.
Jun 26 02:48:20.151301 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Successfully created port: f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:48:20.153881 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:20.160653 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:48:20.163108 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:48:20.163581 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Creating image(s)
Jun 26 02:48:20.164086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:48:20.164222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Ensure instance console log exists: /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:20.164456 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:20.164655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:20.164775 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:20.165582 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Start _get_guest_xml network_info=[{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '573748db-d026-4f6c-80eb-beaceb08015a', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ecba11d0-cb36-45bd-afce-8a4a2666c369', 'attached_at': '', 'detached_at': '', 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'serial': '76e72eb2-642a-4440-b292-3986774c1094'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:20.171131 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:20.173585 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-7596561', uuid='ecba11d0-cb36-45bd-afce-8a4a2666c369'), owner=OwnerMeta(userid='dabf44f7bd7d4f0bb60de94c0db9de53', username='tempest-TestVolumeBootPatternV346-766983106-project-member', projectid='addc661d189b4a8c8e130200e4d2c30a', projectname='tempest-TestVolumeBootPatternV346-766983106'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442100.1723998) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:20.177958 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:20.178371 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:20.182347 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:20.182613 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:20.183780 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:20.184070 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:20.184279 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:20.184462 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:20.184638 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:20.184709 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:20.185061 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:20.185249 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:20.185430 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:20.185562 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:20.185669 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:20.185795 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:20.196370 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:20.196635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:20.196759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:20.304301 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:48:20.361165 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:20.522774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:20.569177 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:20.575395 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:20.582505 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:20.594434 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.599425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.605861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.617564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.617564 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.617564 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.617564 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.617564 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:20.617785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.617785 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.617785 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.617785 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.617785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:20.619348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.619348 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.619348 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.619348 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.619348 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:20.619769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.619769 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.619769 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.619769 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.619769 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:20.653670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.40.100,3260]
Jun 26 02:48:20.653670 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:20.653670 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.666808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.882s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:20.668752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.670751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.146s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:20.673262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.50.100,3260]
Jun 26 02:48:20.673262 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:20.673262 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.685837 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.686082 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:20.688608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:20.688920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:20.689388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:20.692069 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('9', '-', '-', 0) found on session 92 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:20.692228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.710964 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:20.711228 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:20.711760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:20.711760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:20.712147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('10', '-', '-', 0) found on session 93 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:20.712285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:20.720377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 92 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:20.720589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:20.733340 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 93 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:20.733581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:20.756132 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:20.759749 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Successfully updated port: f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:48:20.770907 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Deleted allocations for instance 35615762-25e8-4ae1-98b8-c0dd0083e709
Jun 26 02:48:20.815833 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Booting with volume 652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 at /dev/vda
Jun 26 02:48:20.843078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-changed-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:20.843078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Refreshing instance network info cache due to event network-changed-f5973d2e-c163-4707-bb63-5191d6b03fa9. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:20.843078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] Acquiring lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:20.843078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] Acquired lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:20.844251 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Refreshing network info cache for port f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:20.882319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:20.900497 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:20.920004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:20.949431 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:21.007796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:21.008228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:21.017948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:21.020715 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:48:21.021125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:21.021364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:21.021755 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:21.022094 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Updating existing volume attachment record: b0cb9174-2826-4c57-85bc-e2de252b4641 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:48:21.043400 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updated VIF entry in instance network info cache for port f54efd61-0762-4cb1-9190-babcc576ccb0. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:21.043400 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updating instance_info_cache with network_info: [{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:21.262637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:21.346215 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:21.433156 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:21.536441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:48:21.550965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11ce7a4c-39b2-46ff-8337-b20b0da82c10 req-abc19cfe-b947-4913-8b85-ccea1e6d7c6a service nova] Releasing lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:21.556990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:21.557367 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:21.600960 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:21.786830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c7e445e-aea0-4c5a-8f40-5adcd3302e19 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.537s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:21.790161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.040s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:21.976528 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:22.060898 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:22.102185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-32758550-7120-4419-bf50-7d5177fbe067 req-3858674c-6a48-44f7-85e9-90b1ef675a71 service nova] Releasing lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:22.102706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquired lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:22.102878 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:22.300995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "35615762-25e8-4ae1-98b8-c0dd0083e709" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.514s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:22.557357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000007341c2f6 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:22.557826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:22.558862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.361s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:22.559240 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:22.559813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:22.560082 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:22.564290 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:22.567869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.899s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:22.575545 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:22.576204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:22.576797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:22.577072 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:22.577941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:22.577941 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:22.591162 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:22.591162 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:22.605778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:22.605778 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094] added
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:22.611082 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:22.612035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:22.612035 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:22.612148 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094] added
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:22.617164 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:22.617439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:22.617707 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0399(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:22.617977 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:22.632416 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deleted allocations for instance 46ef890d-4bdc-419c-b393-b2f4bb5651d3
Jun 26 02:48:22.672058 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:22.766586 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:22.873529 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:22.905473 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:23.031074 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Updating instance_info_cache with network_info: [{"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:23.072724 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attempting to attach volume 30e69043-4f4b-47f3-b252-4718d5d2e28b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:23.074301 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:48:23.148830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:48:23.150240 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:48:23.150797 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Creating image(s)
Jun 26 02:48:23.151253 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:48:23.151544 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Ensure instance console log exists: /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:23.152489 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:23.152811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:23.153055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:23.533084 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Releasing lock "refresh_cache-05f1b3fb-23f5-44a0-8598-1dc4be523f89" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:23.533451 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance network_info: |[{"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:48:23.534546 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Start _get_guest_xml network_info=[{"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b0cb9174-2826-4c57-85bc-e2de252b4641', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '05f1b3fb-23f5-44a0-8598-1dc4be523f89', 'attached_at': '', 'detached_at': '', 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'serial': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:23.540070 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:23.541961 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='05f1b3fb-23f5-44a0-8598-1dc4be523f89'), owner=OwnerMeta(userid='1cedb95c2c824de4a4094fbc0fb78818', username='tempest-ImageDependencyTests-1109640317-project-member', projectid='13e495387d164138b6b3789f33fdac7f', projectname='tempest-ImageDependencyTests-1109640317'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442103.5412216) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:23.543810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:23.544198 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:23.546251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:23.546526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:23.547694 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:23.548015 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:23.548196 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:23.548308 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:23.548503 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:23.548838 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:23.548838 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:23.548944 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:23.549074 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:23.549212 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:23.549336 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:23.549548 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:23.565329 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:23.565693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:23.565832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:23.612650 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:23.618625 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:23.628749 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:23.639593 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.645020 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b5caef5a-943f-45be-b98a-45c2577f114d tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.131s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:23.646645 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.647506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.437s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:23.648987 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 26 02:48:23.648987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "46ef890d-4bdc-419c-b393-b2f4bb5651d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:23.659833 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.666879 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.667144 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.678778 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.679063 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:23.717443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.40.100,3260]
Jun 26 02:48:23.717443 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:23.717443 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.729506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.50.100,3260]
Jun 26 02:48:23.729506 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:23.729506 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.735945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.745398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('11', '-', '-', 0) found on session 94 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:23.758819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.768779 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:23.769206 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:23.769516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:23.769516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:23.770665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('12', '-', '-', 0) found on session 95 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:23.770827 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:23.777945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 94 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:23.778238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:23.795901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 95 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:23.796120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:24.577670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:48:24.732754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:24.732875 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:24.732972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:24.733091 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:a6:ed:f4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:25.090322 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:25.090535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:25.090736 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "266d20a5-b882-4896-9d47-a60855b80312-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:25.091870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:25.091870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:25.093135 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Terminating instance
Jun 26 02:48:25.594179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Found WWN 3300000005c5d188e for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:25.594578 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:25.594861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== connect_volume: return (5398ms) {'type': 'block', 'scsi_wwn': '3300000005c5d188e', 'path': '/dev/dm-4', 'multipath_id': '3300000005c5d188e'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:25.594988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c5d188e', 'path': '/dev/dm-4', 'multipath_id': '3300000005c5d188e'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:25.595274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.029s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:25.595582 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:25.596562 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:48:25.610178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:25.610702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:25.611204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:25.611496 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:25.611868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:25.612084 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:25.628745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:25.628745 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:25.629808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:25.634875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:25.634875 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:25.636274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6] added
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:25.652383 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:25.652642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:25.652891 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6] added
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:25.653528 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:25.653767 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:25.653873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:25.654046 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0426(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:25.654201 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:25.662622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:25.811435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:25.816669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:25.939434 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999685063000015 future=<Future at 0x72e29c2448f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:25.940278 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Instance destroyed successfully.
Jun 26 02:48:25.940716 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 266d20a5-b882-4896-9d47-a60855b80312 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:26.102557 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-7596561',display_name='tempest-TestVolumeBootPatternV346-server-7596561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-7596561',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzoZz/vozZEekxjG7Eb7ttw8Xnf9ue4cUrHfqj4mK1NC5qY5tKJnROwQbw3S+9c+aBQ6UsLdwhMVT4qcsARGUJ79cVnWmKBtUb5jcVZVhe+Bt5E9bWLD7tVUJTb9jGBgA==',key_name='tempest-keypair-350272651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-uquos0w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=ecba11d0-cb36-45bd-afce-8a4a2666c369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:26.102557 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:26.102557 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:26.103943 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'pci_devices' on Instance uuid ecba11d0-cb36-45bd-afce-8a4a2666c369 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:26.156897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:26.157232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:26.293367 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-743446d4-d794-44ce-bc89-37ab541e20d6 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:26.443251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1997991914',display_name='tempest-ServerRescueNegativeTestJSON-server-1997991914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1997991914',id=31,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:45:54Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-45b7r4od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:45:55Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=266d20a5-b882-4896-9d47-a60855b80312,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:26.443492 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "address": "fa:16:3e:de:90:2e", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b20aa7-5a", "ovs_interfaceid": "56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:26.444030 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:26.444267 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:26.448327 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.451272 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56b20aa7-5a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.452950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.455810 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:26.456541 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.456745 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=120e63a0-22d9-4d1c-b605-2b150140a287) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.459603 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:26.461414 np0000003683 nova-compute[98991]: INFO os_vif [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:2e,bridge_name='br-int',has_traffic_filtering=True,id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b20aa7-5a')
Jun 26 02:48:26.461716 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Deleting instance files /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312_del
Jun 26 02:48:26.463089 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Deletion of /opt/stack/data/nova/instances/266d20a5-b882-4896-9d47-a60855b80312_del complete
Jun 26 02:48:26.580581 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00041847700003927457 future=<Future at 0x72e27c268fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:26.580996 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442091.580056, 35615762-25e8-4ae1-98b8-c0dd0083e709 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:26.581196 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] VM Stopped (Lifecycle Event)
Jun 26 02:48:26.581860 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:26.581860 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.785006297000109 future=<Future at 0x72e27c570d40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:26.581860 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.784914025000035 future=<Future at 0x72e27c570d40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <uuid>ecba11d0-cb36-45bd-afce-8a4a2666c369</uuid>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <name>instance-0000002e</name>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPatternV346-server-7596561</nova:name>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:20</nova:creationTime>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:user uuid="dabf44f7bd7d4f0bb60de94c0db9de53">tempest-TestVolumeBootPatternV346-766983106-project-member</nova:user>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:project uuid="addc661d189b4a8c8e130200e4d2c30a">tempest-TestVolumeBootPatternV346-766983106</nova:project>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         <nova:port uuid="f54efd61-0762-4cb1-9190-babcc576ccb0">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="serial">ecba11d0-cb36-45bd-afce-8a4a2666c369</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="uuid">ecba11d0-cb36-45bd-afce-8a4a2666c369</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/disk.config"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <alias name="ua-76e72eb2-642a-4440-b292-3986774c1094"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <serial>76e72eb2-642a-4440-b292-3986774c1094</serial>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:14:95:1c"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <target dev="tapf54efd61-07"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/console.log" append="off"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Preparing to wait for external event network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-7596561',display_name='tempest-TestVolumeBootPatternV346-server-7596561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-7596561',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzoZz/vozZEekxjG7Eb7ttw8Xnf9ue4cUrHfqj4mK1NC5qY5tKJnROwQbw3S+9c+aBQ6UsLdwhMVT4qcsARGUJ79cVnWmKBtUb5jcVZVhe+Bt5E9bWLD7tVUJTb9jGBgA==',key_name='tempest-keypair-350272651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-uquos0w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=ecba11d0-cb36-45bd-afce-8a4a2666c369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:26.611289 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:26.613999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.613999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.613999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:26.615851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.616037 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6012d2b5-865d-56b7-a976-2324d906c7e7', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.618839 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:26.620568 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.620703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf54efd61-07, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.620981 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf54efd61-07, col_values=(('qos', UUID('4d63a10d-e111-4419-a94c-2b0c80478cd1')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.621121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf54efd61-07, col_values=(('external_ids', {'iface-id': 'f54efd61-0762-4cb1-9190-babcc576ccb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:95:1c', 'vm-uuid': 'ecba11d0-cb36-45bd-afce-8a4a2666c369'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:26.624389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:26.628753 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:26.630283 np0000003683 nova-compute[98991]: INFO os_vif [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07')
Jun 26 02:48:26.654495 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:26.655054 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:26.660026 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:26.669649 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:26.676392 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.683797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.694834 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.709990 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.710223 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.715916 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.716141 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:26.769363 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.50.100,3260]
Jun 26 02:48:26.769363 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:26.769363 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.781662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.795249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.40.100,3260]
Jun 26 02:48:26.795249 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:26.795249 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.800170 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.800576 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:26.800819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:26.800819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:26.801844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] HCTL ('15', '-', '-', 0) found on session 96 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:26.802016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:26.813877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:26.823857 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Searching for a device in session 96 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:26.827701 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] HCTL ('16', '-', '-', 0) found on session 97 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:26.842937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:26.860775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Searching for a device in session 97 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:26.860775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:26.973023 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:48:26.973826 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:48:26.974147 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:48:26.974302 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:48:26.974600 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:26.981065 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:27.083827 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c6a58330-d0d5-4337-bf2b-e5f83dbeb7bf tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 35615762-25e8-4ae1-98b8-c0dd0083e709] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:27.097148 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:27.496066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f84526-7731-4eca-b03a-e11240e0556a req-ff7de77f-9c39-4477-a015-354cf011d9b9 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Received event network-vif-deleted-56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:27.496602 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-21f84526-7731-4eca-b03a-e11240e0556a req-ff7de77f-9c39-4477-a015-354cf011d9b9 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Neutron deleted interface 56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667; detaching it from the instance and deleting it from the info cache
Jun 26 02:48:27.498939 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21f84526-7731-4eca-b03a-e11240e0556a req-ff7de77f-9c39-4477-a015-354cf011d9b9 service nova] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Detach interface failed, port_id=56b20aa7-5ac5-4d4e-8bd0-9dec4a1d7667, reason: Instance 266d20a5-b882-4896-9d47-a60855b80312 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:48:27.612187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:48:27.665687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:27.904904 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:27.975617 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:27.975824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:27.975899 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Shelving
Jun 26 02:48:28.083925 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:28.084137 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:28.147349 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:28.147539 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:28.147539 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No VIF found with MAC fa:16:3e:14:95:1c, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:28.147912 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Using config drive
Jun 26 02:48:28.407209 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Took 1.43 seconds to deallocate network for instance.
Jun 26 02:48:28.585668 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:48:28.634154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Found WWN 330000000e3913bd9 for multipath device dm-10 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:28.634154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:28.634154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] <== connect_volume: return (5068ms) {'type': 'block', 'scsi_wwn': '330000000e3913bd9', 'path': '/dev/dm-10', 'multipath_id': '330000000e3913bd9'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:28.634154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3913bd9', 'path': '/dev/dm-10', 'multipath_id': '330000000e3913bd9'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:28.654018 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:28.736776 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:28.737656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:28.737891 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attaching volume 30e69043-4f4b-47f3-b252-4718d5d2e28b to /dev/vdb
Jun 26 02:48:28.796750 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:28.801721 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Creating config drive at /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/disk.config
Jun 26 02:48:28.806183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd90y37z1 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:28.824961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:28.847057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:28.862175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd90y37z1" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:28.891172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:28.891759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:28.901358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:28.904107 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:48:28.904107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:28.904107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:28.904107 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:28.907493 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating existing volume attachment record: 61b2a7c3-2758-4e01-b416-6927d0efca44 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:48:28.915429 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:28.916787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:29.020849 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.026700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.060937 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.065791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.093614 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.143704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='instance-depend-image',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e495387d164138b6b3789f33fdac7f',ramdisk_id='',reservation_id='r-0xqhl3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1109640317',owner_user_name='tempest-ImageDependencyTests-1109640317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:20Z,user_data=None,user_id='1cedb95c2c824de4a4094fbc0fb78818',uuid=05f1b3fb-23f5-44a0-8598-1dc4be523f89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:29.143704 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converting VIF {"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:29.143704 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:29.145044 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f1b3fb-23f5-44a0-8598-1dc4be523f89 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:29.148504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:29.328695 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.342508 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.437765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.444496 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999691074999646 future=<Future at 0x72e29c67ab40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:29.450836 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance destroyed successfully.
Jun 26 02:48:29.450836 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'numa_topology' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:29.469589 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.471442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.495224 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:29.495690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:29.495844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:29.573082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.585190 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:29.585486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:29.585707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:29.585876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:29.586045 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] No waiting events found dispatching network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:29.586917 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received unexpected event network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd for instance with vm_state active and task_state shelving.
Jun 26 02:48:29.587068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:29.587245 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:29.587437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:29.587605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:29.587754 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] No waiting events found dispatching network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:29.587888 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-4704b57c-344c-4f1b-bc24-79df637a7301 req-78be1020-fbcc-485e-8966-71a8f9370c00 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received unexpected event network-vif-unplugged-389ac5ac-04ef-4796-b021-984e9d1f73cd for instance with vm_state active and task_state shelving.
Jun 26 02:48:29.617405 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:29.618036 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:29.645042 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d593442-4e78-4c6b-a325-3168bd929109 req-18c93b11-9a02-4e1e-8640-290f8dd9bd34 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:29.645496 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d593442-4e78-4c6b-a325-3168bd929109 req-18c93b11-9a02-4e1e-8640-290f8dd9bd34 service nova] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:29.647090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d593442-4e78-4c6b-a325-3168bd929109 req-18c93b11-9a02-4e1e-8640-290f8dd9bd34 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:29.647682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d593442-4e78-4c6b-a325-3168bd929109 req-18c93b11-9a02-4e1e-8640-290f8dd9bd34 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:29.647767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d593442-4e78-4c6b-a325-3168bd929109 req-18c93b11-9a02-4e1e-8640-290f8dd9bd34 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Processing event network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <uuid>05f1b3fb-23f5-44a0-8598-1dc4be523f89</uuid>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <name>instance-0000002f</name>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:name>instance-depend-image</nova:name>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:23</nova:creationTime>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:user uuid="1cedb95c2c824de4a4094fbc0fb78818">tempest-ImageDependencyTests-1109640317-project-member</nova:user>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:project uuid="13e495387d164138b6b3789f33fdac7f">tempest-ImageDependencyTests-1109640317</nova:project>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         <nova:port uuid="f5973d2e-c163-4707-bb63-5191d6b03fa9">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="192.168.233.226" ipVersion="4"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="serial">05f1b3fb-23f5-44a0-8598-1dc4be523f89</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="uuid">05f1b3fb-23f5-44a0-8598-1dc4be523f89</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/disk.config"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <alias name="ua-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-10"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <serial>652a3fc3-2e76-4021-8c96-ec8fe9fac8e6</serial>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:9c:54:c7"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <target dev="tapf5973d2e-c1"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/console.log" append="off"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:29.651451 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Preparing to wait for external event network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='instance-depend-image',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e495387d164138b6b3789f33fdac7f',ramdisk_id='',reservation_id='r-0xqhl3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1109640317',owner_user_name='tempest-ImageDependencyTests-1109640317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:20Z,user_data=None,user_id='1cedb95c2c824de4a4094fbc0fb78818',uuid=05f1b3fb-23f5-44a0-8598-1dc4be523f89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:29.654379 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converting VIF {"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:29.654846 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:29.658980 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:29.661006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.661006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:29.661006 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:29.663270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.663270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bdcaa4d-c984-5ab9-9e13-f582b4719a27', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:29.666150 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:29.672154 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.674631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.674858 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5973d2e-c1, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:29.675232 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5973d2e-c1, col_values=(('qos', UUID('459f4cf0-e739-45d5-a2ec-57892ef1fe71')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:29.675464 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5973d2e-c1, col_values=(('external_ids', {'iface-id': 'f5973d2e-c163-4707-bb63-5191d6b03fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:54:c7', 'vm-uuid': '05f1b3fb-23f5-44a0-8598-1dc4be523f89'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:29.679341 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:29.689073 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.690008 np0000003683 nova-compute[98991]: INFO os_vif [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1')
Jun 26 02:48:29.824839 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.837118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.842643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.869921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:29.885434 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:30.053594 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Beginning cold snapshot process
Jun 26 02:48:30.123273 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:30.283635 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:48:30.284675 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442110.2842727, ecba11d0-cb36-45bd-afce-8a4a2666c369 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:30.284868 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] VM Started (Lifecycle Event)
Jun 26 02:48:30.286980 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:48:30.290847 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Instance spawned successfully.
Jun 26 02:48:30.291637 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:48:30.634103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.717s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:30.635879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.486s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:30.639228 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:48:30.639442 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Claim successful on node np0000003683
Jun 26 02:48:30.691739 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Deleted allocations for instance 266d20a5-b882-4896-9d47-a60855b80312
Jun 26 02:48:30.789677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:30.791316 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:30.798252 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.798431 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.798689 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.799003 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.799228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.799437 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:30.959918 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.464s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:30.960212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:30.973504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:30.974016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:30.974472 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:30.974672 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:30.975015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:30.975210 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:30.986791 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:30.989464 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:30.999111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:31.009862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:31.018929 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:31.019347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:31.019703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:31.020257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('9', '0', '0', 0) found on session 92 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:31.020380 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:31.032212 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:31.032693 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:31.032996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:31.033132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:31.034079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 92 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:31.034654 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:31.035250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('10', '0', '0', 0) found on session 93 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:31.035421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:31.049937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 93 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:31.050059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:31.211350 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:31.211562 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:31.211735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] No VIF found with MAC fa:16:3e:9c:54:c7, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:31.212218 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Using config drive
Jun 26 02:48:31.293620 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:31.293914 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442111.2937095, ecba11d0-cb36-45bd-afce-8a4a2666c369 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:31.294072 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] VM Paused (Lifecycle Event)
Jun 26 02:48:31.305888 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Took 11.14 seconds to spawn the instance on the hypervisor.
Jun 26 02:48:31.306114 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:31.570600 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:48:31.571556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk /opt/stack/data/nova/instances/snapshots/tmpblr_4fxv/102104860b9c4ed8a0556b4b23644977 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:31.700704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-97407767-abc5-4270-96c8-0e234ad3e612 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "266d20a5-b882-4896-9d47-a60855b80312" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.610s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:31.720781 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:31.731972 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:31.732174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:31.732343 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:31.732515 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:31.732698 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] No waiting events found dispatching network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:31.732813 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-2bf804c9-ab32-4608-a867-5d78eaf6b300 req-ea8f500a-f341-44aa-ae64-77838860c260 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received unexpected event network-vif-plugged-f54efd61-0762-4cb1-9190-babcc576ccb0 for instance with vm_state active and task_state None.
Jun 26 02:48:31.796470 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:31.804963 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442111.804626, ecba11d0-cb36-45bd-afce-8a4a2666c369 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:31.805129 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] VM Resumed (Lifecycle Event)
Jun 26 02:48:31.820193 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Took 19.25 seconds to build instance.
Jun 26 02:48:31.867247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk /opt/stack/data/nova/instances/snapshots/tmpblr_4fxv/102104860b9c4ed8a0556b4b23644977" returned: 0 in 0.296s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:31.867723 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Snapshot extracted, beginning image upload
Jun 26 02:48:31.907792 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Creating config drive at /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/disk.config
Jun 26 02:48:31.911576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdjszahxt {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:31.974168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdjszahxt" returned: 0 in 0.062s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:31.977013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:48:31.981223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.289017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:32.289228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:32.289450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:32.289601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:32.289708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:32.292181 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Terminating instance
Jun 26 02:48:32.319199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:32.322533 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1bf76a7-cb5f-4d5e-99a1-6022c882f418 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.757s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:32.323054 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.590s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:32.323339 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] During sync_power_state the instance has a pending task (networking). Skip.
Jun 26 02:48:32.323552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:32.338105 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:32.342990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:32.343246 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:32.367239 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004312490000302205 future=<Future at 0x72e27c570d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:32.367750 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Emitting event <LifecycleEvent: 1782442097.3667092, 46ef890d-4bdc-419c-b393-b2f4bb5651d3 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:32.367905 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:32.368103 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] VM Stopped (Lifecycle Event)
Jun 26 02:48:32.369253 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.569811257999845 future=<Future at 0x72e29c2448f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:32.369358 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.569691414999852 future=<Future at 0x72e29c2448f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:32.427724 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.503365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.505373 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.533755 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.692548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4fe38038-825e-4beb-b782-548ea10c6f56 req-a4597894-a8e9-4642-8c9f-972a730a9269 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:32.693158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fe38038-825e-4beb-b782-548ea10c6f56 req-a4597894-a8e9-4642-8c9f-972a730a9269 service nova] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:32.693550 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fe38038-825e-4beb-b782-548ea10c6f56 req-a4597894-a8e9-4642-8c9f-972a730a9269 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:32.693550 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fe38038-825e-4beb-b782-548ea10c6f56 req-a4597894-a8e9-4642-8c9f-972a730a9269 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:32.693718 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4fe38038-825e-4beb-b782-548ea10c6f56 req-a4597894-a8e9-4642-8c9f-972a730a9269 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Processing event network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:48:32.795668 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:48:32.826998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.832458 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.835383 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.848578 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:32.858442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.865551 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.871571 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.871571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 46ef890d-4bdc-419c-b393-b2f4bb5651d3] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:32.901867 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.912643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:32.994720 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:32.995289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:32.995438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:32.996163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:32.996350 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:32.996537 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fd9ebe0e-af57-4f11-a2f8-9a891b77b11a req-20eb7bef-3363-4c31-9069-2bf0a2ea4b03 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:32.998358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000007341c2f6 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:32.998862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:32.999110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (3503ms) {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:32.999295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:33.002732 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:33.053362 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.088293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.090515 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.166361 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99967283199976 future=<Future at 0x72e27c4acfe0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:33.170921 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Instance destroyed successfully.
Jun 26 02:48:33.171262 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lazy-loading 'resources' on Instance uuid 121ec5e6-08cf-4e0c-9c89-e2be23a274be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:33.322698 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:48:33.323082 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442113.3228002, 05f1b3fb-23f5-44a0-8598-1dc4be523f89 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:33.323277 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] VM Started (Lifecycle Event)
Jun 26 02:48:33.325504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:48:33.331159 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance spawned successfully.
Jun 26 02:48:33.332501 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:48:33.361744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.727s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:33.362593 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:48:33.506222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attempting to attach volume 30e69043-4f4b-47f3-b252-4718d5d2e28b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:33.510198 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:48:33.673355 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1145245523',display_name='tempest-ServerRescueNegativeTestJSON-server-1145245523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-serverrescuenegativetestjson-server-1145245523',id=30,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:08Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2b07c33d4ed466ca32fa63a7e8b74e4',ramdisk_id='',reservation_id='r-o4z3j5hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027165143',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027165143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:15Z,user_data=None,user_id='94a20c5b3a594daaacb7bef508d1ee86',uuid=121ec5e6-08cf-4e0c-9c89-e2be23a274be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:33.673574 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converting VIF {"id": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "address": "fa:16:3e:e5:78:7d", "network": {"id": "9d608528-fe3a-4796-99b3-72eb4d1e1469", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-169342746-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d2b07c33d4ed466ca32fa63a7e8b74e4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff2ad29d-7b", "ovs_interfaceid": "ff2ad29d-7b0f-4c47-a3d3-966e884feec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:33.674244 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:33.674527 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:33.675962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.676154 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff2ad29d-7b, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:33.677378 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.678110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:33.683107 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.683811 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.683955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ce3d16-287e-497e-bb92-8c63821ce443) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:33.684835 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.685004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:33.692679 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:33.694369 np0000003683 nova-compute[98991]: INFO os_vif [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6,network=Network(9d608528-fe3a-4796-99b3-72eb4d1e1469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff2ad29d-7b')
Jun 26 02:48:33.694799 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Deleting instance files /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be_del
Jun 26 02:48:33.695746 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Deletion of /opt/stack/data/nova/instances/121ec5e6-08cf-4e0c-9c89-e2be23a274be_del complete
Jun 26 02:48:33.795958 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-changed-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:33.796433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Refreshing instance network info cache due to event network-changed-f54efd61-0762-4cb1-9190-babcc576ccb0. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:33.796657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] Acquiring lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:33.796797 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] Acquired lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:33.796960 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Refreshing network info cache for port f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:33.827679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:33.829744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:33.840843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.841181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.841725 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.842119 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.842450 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.842685 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:33.867835 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:48:33.868053 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:48:33.870010 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:33.870384 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:33.962226 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13af0bfb96bf40179144f66af7baeed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419e029cdd744c1598f7a9d2bcc52340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:48:34.205995 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 26 02:48:34.206715 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:48:34.207030 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:48:34.207164 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:48:34.208242 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:34.299962 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:34.331808 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:34.332111 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442114.3319097, 05f1b3fb-23f5-44a0-8598-1dc4be523f89 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:34.332246 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] VM Paused (Lifecycle Event)
Jun 26 02:48:34.350546 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Took 11.20 seconds to spawn the instance on the hypervisor.
Jun 26 02:48:34.350763 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:34.370286 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:34.373862 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:48:34.375539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:34.604776 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Successfully created port: 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:48:34.700140 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Snapshot image upload complete
Jun 26 02:48:34.700496 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:34.735856 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:34.755834 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:34.756069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:34.756276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:34.756449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:34.756622 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] No waiting events found dispatching network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:34.758590 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e103caa0-4167-427b-9ab1-1594fbfa898e req-f37d5689-9e7d-4b4a-b874-dd7c18eea163 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received unexpected event network-vif-plugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 for instance with vm_state active and task_state None.
Jun 26 02:48:34.835190 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:34.837526 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442114.8372087, 05f1b3fb-23f5-44a0-8598-1dc4be523f89 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:34.837690 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] VM Resumed (Lifecycle Event)
Jun 26 02:48:34.864323 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Took 21.15 seconds to build instance.
Jun 26 02:48:34.880693 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:48:34.893644 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updated VIF entry in instance network info cache for port f54efd61-0762-4cb1-9190-babcc576ccb0. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:34.894232 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updating instance_info_cache with network_info: [{"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:35.056187 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:35.056755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] Acquiring lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:35.056755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:35.056859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:35.057004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] No waiting events found dispatching network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:35.057119 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-unplugged-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:35.057247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Received event network-vif-deleted-ff2ad29d-7b0f-4c47-a3d3-966e884feec6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:35.057879 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Neutron deleted interface ff2ad29d-7b0f-4c47-a3d3-966e884feec6; detaching it from the instance and deleting it from the info cache
Jun 26 02:48:35.059823 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-042a164d-92ca-4146-85ba-d709fac60cf1 req-be9dfef5-ccc9-4033-b0c5-7b195ed241b1 service nova] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Detach interface failed, port_id=ff2ad29d-7b0f-4c47-a3d3-966e884feec6, reason: Instance 121ec5e6-08cf-4e0c-9c89-e2be23a274be could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:48:35.177949 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:35.178271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:35.178485 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:35.178759 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:18:02:69, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:35.182835 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:35.212082 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Shelve offloading
Jun 26 02:48:35.312937 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Successfully updated port: 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:48:35.340054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:35.341831 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:35.365876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.660s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:35.366276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.631s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:35.397001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5cc73df-116f-4357-bf8f-d99e6ca3f2cc req-1fa8ab3d-cbb7-4b46-b68e-d0eab78a62ec service nova] Releasing lock "refresh_cache-ecba11d0-cb36-45bd-afce-8a4a2666c369" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:35.686387 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Took 1.48 seconds to deallocate network for instance.
Jun 26 02:48:35.718925 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance destroyed successfully.
Jun 26 02:48:35.719616 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:35.721826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:35.721962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:35.722102 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:35.814919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:35.815009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:35.815145 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:35.866518 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-changed-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:35.868691 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Refreshing instance network info cache due to event network-changed-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:35.868927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:35.870351 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:35.893028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:48:35.894024 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:48:35.894505 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Creating image(s)
Jun 26 02:48:35.894969 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:35.895133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:35.895625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:35.896419 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:35.900313 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:35.901363 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:35.996865 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:35.997351 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:35.997901 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:35.998407 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:36.001795 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:36.002532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:36.092077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:36.092587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:36.148564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk 1073741824" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:36.149060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:36.149411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:36.203185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:36.203526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:36.224624 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:36.248053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:36.249807 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:48:36.252332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:36.293117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-fd82422e-8989-4125-a0af-425e17ad8279 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.555s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:36.356159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:36.356723 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Cannot resize image /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:48:36.357057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:48:36.357229 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Ensure instance console log exists: /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:36.357538 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:36.357750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:36.357904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:36.437280 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:48:36.645957 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:36.697929 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:36.810641 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:36.891638 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:36.982636 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:36.993996 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:36.994317 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:37.312603 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:37.312927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance network_info: |[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:48:37.313473 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:37.316741 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Refreshing network info cache for port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:37.317633 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start _get_guest_xml network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:37.319754 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:37.321927 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-388591585', uuid='126a33da-d066-4fbf-bb4c-5da1f41252ed'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442117.3206027) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:37.321927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:37.322355 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:37.323318 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:37.323374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:37.324189 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:37.324492 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:37.324630 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:37.324716 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:37.324830 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:37.324905 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:37.325032 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:37.325197 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:37.325290 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:37.325419 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:37.325518 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:37.325628 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:37.336190 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:37.336422 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:37.336876 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:37.337721 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'pci_devices' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:37.393795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:37.394126 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:37.394338 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:37.499506 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:37.819394 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <uuid>126a33da-d066-4fbf-bb4c-5da1f41252ed</uuid>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <name>instance-00000030</name>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-388591585</nova:name>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:37</nova:creationTime>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         <nova:port uuid="0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="serial">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="uuid">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1a:81:38"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <target dev="tap0cc1c496-63"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/console.log" append="off"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:37.840268 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Preparing to wait for external event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:37.843690 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:37.847730 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.848067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:37.848325 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:37.851280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.851658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26e2f714-6539-5e6d-bd98-49d058a1424b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:37.854969 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.855875 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:37.868742 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.875189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.879459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cc1c496-63, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:37.879459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cc1c496-63, col_values=(('qos', UUID('df9ce035-98e0-4b8e-91f1-4dfdb620e59a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:37.879459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cc1c496-63, col_values=(('external_ids', {'iface-id': '0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:81:38', 'vm-uuid': '126a33da-d066-4fbf-bb4c-5da1f41252ed'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:37.879459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.880176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:37.889075 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:37.890466 np0000003683 nova-compute[98991]: INFO os_vif [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:48:37.945909 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance destroyed successfully.
Jun 26 02:48:37.945909 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'resources' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:38.005161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:38.007131 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing instance network info cache due to event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:38.007685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.803s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:38.009923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:38.010035 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:38.010279 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:38.094828 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Deleted allocations for instance 121ec5e6-08cf-4e0c-9c89-e2be23a274be
Jun 26 02:48:38.132680 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:38.289540 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updated VIF entry in instance network info cache for port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:38.289834 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:38.449008 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:38.449815 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYfQJzr8ZsXiFl/EGHeKsNky0xLWQG/tyV8JJtHK7MYw0OaU8uuBbIk7xVbmqScqG/XZgEHZae++Bzuk+oUSgVtdwYusj+0+YYRFY9VieKYGtvXjSHf7bu2FCrnZeVkg==',key_name='tempest-keypair-111261166',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:47Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:48:34.700189',shelved_host='np0000003683',shelved_image_id='08522427-36de-4852-a996-558b69cd33b8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:38.450074 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:38.450718 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:38.451951 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:38.453281 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.453540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap389ac5ac-04, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:38.454703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.455279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:38.460223 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.460999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.461200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f420dae7-a1bb-433e-9c7b-0f5415f4a77f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:38.461748 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.462231 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:38.466994 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:38.469163 np0000003683 nova-compute[98991]: INFO os_vif [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04')
Jun 26 02:48:38.469533 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Deleting instance files /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155_del
Jun 26 02:48:38.475427 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Deletion of /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155_del complete
Jun 26 02:48:38.512924 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:38.791847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-76f07b32-4eb6-4e84-81a5-7768d7070de4 req-f8c9e722-4011-46bd-98ab-9e3a661282e9 service nova] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:38.809405 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Stashing vm_state: active {{(pid=98991) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 26 02:48:38.898629 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:39.047824 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updated VIF entry in instance network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:39.048459 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap389ac5ac-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:39.057633 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Deleted allocations for instance e6978931-a3e5-47b1-8d77-29481b046155
Jun 26 02:48:39.114174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e16d005a-c034-4d05-a0b8-439b4e661d87 tempest-ServerRescueNegativeTestJSON-1027165143 tempest-ServerRescueNegativeTestJSON-1027165143-project-member] Lock "121ec5e6-08cf-4e0c-9c89-e2be23a274be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.825s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:39.372534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:39.372781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:39.411465 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:39.411616 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:39.411730 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:1a:81:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:39.412223 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Using config drive
Jun 26 02:48:39.550626 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d1469a9-9ee8-4664-b7d3-755822e39bb5 req-cbcb1b58-144f-4938-a067-594b2570b8a1 service nova] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:39.562115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:39.881386 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:48:39.881721 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Claim successful on node np0000003683
Jun 26 02:48:39.918728 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:39.997077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:39.997644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:39.999540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:39.999540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:39.999540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:40.000983 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Terminating instance
Jun 26 02:48:40.061988 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Creating config drive at /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config
Jun 26 02:48:40.070966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn6k6y0ey {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:40.134648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn6k6y0ey" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:40.396863 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating resource usage from migration c080da60-adbe-4862-b2d8-64e733a9b739
Jun 26 02:48:40.506852 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:48:40.549199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.595498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.622910 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.723011 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.746335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:40.747436 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.747436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:40.749673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:40.749795 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:40.749955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] No waiting events found dispatching network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:40.750028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-99145c3a-768a-4689-acad-cdc428bf230a req-8ea6b82c-c3f1-4eb4-9572-cb430392e504 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:40.801858 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.825464 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.841190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:40.887325 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99954104599965 future=<Future at 0x72e27c2b36e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:40.889836 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Instance destroyed successfully.
Jun 26 02:48:40.890309 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lazy-loading 'resources' on Instance uuid 05f1b3fb-23f5-44a0-8598-1dc4be523f89 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:40.939524 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004165240002294013 future=<Future at 0x72e29c2448f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:40.943566 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442105.938985, 266d20a5-b882-4896-9d47-a60855b80312 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:40.943813 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:40.944086 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] VM Stopped (Lifecycle Event)
Jun 26 02:48:40.945522 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.497546005000004 future=<Future at 0x72e29c67ab40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:40.945676 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.4971638539996093 future=<Future at 0x72e29c67ab40 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:41.059231 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:41.059470 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:41.166391 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.172930 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.177305 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.205442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.213932 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.393575 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='instance-depend-image',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:34Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13e495387d164138b6b3789f33fdac7f',ramdisk_id='',reservation_id='r-0xqhl3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1109640317',owner_user_name='tempest-ImageDependencyTests-1109640317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:48:34Z,user_data=None,user_id='1cedb95c2c824de4a4094fbc0fb78818',uuid=05f1b3fb-23f5-44a0-8598-1dc4be523f89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:41.393858 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converting VIF {"id": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "address": "fa:16:3e:9c:54:c7", "network": {"id": "945817a2-2896-4973-ae2d-f5507acd8fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7402a80596f489488cac8cab13bac60", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5973d2e-c1", "ovs_interfaceid": "f5973d2e-c163-4707-bb63-5191d6b03fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:41.394742 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:41.395071 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:41.397118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.397401 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5973d2e-c1, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:41.398393 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.399235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:41.401066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.402132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.402286 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=459f4cf0-e739-45d5-a2ec-57892ef1fe71) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:41.404163 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:41.404961 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:41.406862 np0000003683 nova-compute[98991]: INFO os_vif [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:54:c7,bridge_name='br-int',has_traffic_filtering=True,id=f5973d2e-c163-4707-bb63-5191d6b03fa9,network=Network(945817a2-2896-4973-ae2d-f5507acd8fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5973d2e-c1')
Jun 26 02:48:41.408897 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:48:41.409416 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:41.409650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:41.410127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:41.410607 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:48:41.410806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:41.439148 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:41.439626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', '98')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:48:41.440115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '97')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:41.441265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6', '96')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:48:41.443028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c37e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:48:41.443123 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:48:41.443656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Flush multipath device 330000000e3913bd9 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:48:41.448200 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 266d20a5-b882-4896-9d47-a60855b80312] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:41.482943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:41.541830 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:48:41.562382 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:41.596636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:48:41.596842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:48:41.598395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:48:41.612595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:48:41.612784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:48:41.627447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.680153 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.40.100,3260]
Jun 26 02:48:41.680153 np0000003683 nova-compute[98991]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:41.680153 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.720020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.737780 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442121.7373946, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:41.737921 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Started (Lifecycle Event)
Jun 26 02:48:41.742723 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.802015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.50.100,3260]
Jun 26 02:48:41.802015 np0000003683 nova-compute[98991]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:41.802015 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.823456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:41.823716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:41.823754 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] <== disconnect_volume: return (414ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:41.823865 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:48:41.824117 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Deleting instance files /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89_del
Jun 26 02:48:41.824563 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Deletion of /opt/stack/data/nova/instances/05f1b3fb-23f5-44a0-8598-1dc4be523f89_del complete
Jun 26 02:48:41.984420 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:42.069048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.696s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:42.069771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.507s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:42.069996 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Migrating
Jun 26 02:48:42.070382 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:48:42.240724 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:42.244213 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442122.2438376, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:42.244453 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Paused (Lifecycle Event)
Jun 26 02:48:42.330343 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Took 1.82 seconds to destroy the instance on the hypervisor.
Jun 26 02:48:42.331700 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:48:42.332154 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:48:42.332317 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:48:42.332609 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:42.422433 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:42.593788 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:42.594068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:42.594666 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:42.695990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:42.696227 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:42.746952 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:42.748990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:42.853989 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:42.854711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Acquiring lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:42.854866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:42.855021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:42.855154 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] No waiting events found dispatching network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:42.855545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-unplugged-f5973d2e-c163-4707-bb63-5191d6b03fa9 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:48:42.855545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:42.855545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:42.855813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:42.855853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:42.856226 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Processing event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:48:42.856226 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a40d10ce-daa7-4ed0-afa8-8ebba543bf23 req-aad05f23-0e08-4aca-8c32-fddbbba2fd24 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state building and task_state spawning.
Jun 26 02:48:42.857464 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:48:42.861447 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:48:42.864204 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance spawned successfully.
Jun 26 02:48:42.864747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:48:43.096924 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:43.199434 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:43.234516 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fae38e27-2db7-4355-9bf3-2555d826bea2 req-e4a01ecb-e6f7-42d2-83a9-9aa10aeb76fa service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Received event network-vif-deleted-f5973d2e-c163-4707-bb63-5191d6b03fa9 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:43.234752 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-fae38e27-2db7-4355-9bf3-2555d826bea2 req-e4a01ecb-e6f7-42d2-83a9-9aa10aeb76fa service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Neutron deleted interface f5973d2e-c163-4707-bb63-5191d6b03fa9; detaching it from the instance and deleting it from the info cache
Jun 26 02:48:43.236539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fae38e27-2db7-4355-9bf3-2555d826bea2 req-e4a01ecb-e6f7-42d2-83a9-9aa10aeb76fa service nova] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Detach interface failed, port_id=f5973d2e-c163-4707-bb63-5191d6b03fa9, reason: Instance 05f1b3fb-23f5-44a0-8598-1dc4be523f89 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:48:43.251688 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:43.252181 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442123.251787, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:43.252181 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Resumed (Lifecycle Event)
Jun 26 02:48:43.374662 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.374806 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.375090 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.375300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.375581 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.375802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:48:43.405764 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:43.531062 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:43.688263 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:43.690165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:43.707602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.638s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:43.756548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:43.761177 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:48:43.879891 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Took 7.99 seconds to spawn the instance on the hypervisor.
Jun 26 02:48:43.880700 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:44.032831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:44.191693 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Took 1.86 seconds to deallocate network for instance.
Jun 26 02:48:44.213015 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-edb64f27-2f20-4c9d-8cc8-fd4f2c8ba83d tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.237s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:44.214662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.524s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:44.215071 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Unshelving
Jun 26 02:48:44.263580 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:48:44.390098 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Took 15.30 seconds to build instance.
Jun 26 02:48:44.443388 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00037378400020315894 future=<Future at 0x72e29c67ab40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:44.443676 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:44.444064 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442109.4427297, e6978931-a3e5-47b1-8d77-29481b046155 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:44.444157 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.7214537519998885 future=<Future at 0x72e27c4acfe0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:44.444285 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.7213113269999667 future=<Future at 0x72e27c4acfe0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:44.445284 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Stopped (Lifecycle Event)
Jun 26 02:48:44.766835 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Took 0.57 seconds to detach 1 volumes for instance.
Jun 26 02:48:44.768764 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Deleting volume: 652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:48:44.889539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.805s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:44.947445 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:45.276289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:45.276705 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:45.279336 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_requests' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:45.315413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:45.547123 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Starting migrate_disk_and_power_off {{(pid=98991) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}}
Jun 26 02:48:45.565541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-changed-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:45.566573 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Refreshing instance network info cache due to event network-changed-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:45.566573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:45.566573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:45.566573 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Refreshing network info cache for port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:45.567259 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.572377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.594497 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.731882 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.739137 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.784503 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'numa_topology' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:45.844329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.859015 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.881222 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99975854100012 future=<Future at 0x72e27c5e66c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:45.884148 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance destroyed successfully.
Jun 26 02:48:45.885255 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:53Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:48:45.885696 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:45.886516 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:45.887338 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:48:45.887798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.888028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7cfe23d-16, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:45.889094 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.889804 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:45.890077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.890856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.891031 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=194280c0-c825-4257-a3fd-f4822fe52e9e) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:45.891547 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:45.892455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:45.894576 np0000003683 nova-compute[98991]: INFO os_vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16')
Jun 26 02:48:46.068847 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:46.286787 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:48:46.287191 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Claim successful on node np0000003683
Jun 26 02:48:46.400371 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:46.436979 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Detected multiple connections on this host for volume: 30e69043-4f4b-47f3-b252-4718d5d2e28b, skipping target disconnect.
Jun 26 02:48:46.440501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:46.536771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:46.539100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:46.563730 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updated VIF entry in instance network info cache for port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:46.564920 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:46.639175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:46.640431 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:46.648687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:46.757271 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:46.757690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk.config /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:46.803888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk.config /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config" returned: 0 in 0.046s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:46.804218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk.info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:46.855547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_resize/disk.info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" returned: 0 in 0.051s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:46.986619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:47.069356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-01e13e2c-dae0-4082-ae82-7910c7a7190e req-366b5568-8d4c-470c-b356-8f40f5121c0b service nova] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:47.644392 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:47.644903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:47.645087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:47.645231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:47.645375 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:47.645513 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received unexpected event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with vm_state active and task_state resize_migrating.
Jun 26 02:48:47.645626 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:47.645753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:47.645866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:47.645979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:47.646079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:47.646189 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a4a78c28-2683-48eb-a7e1-b44d51c8a7c4 req-8be0f64f-b079-4bc0-9305-0dc3e84eecd7 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received unexpected event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with vm_state active and task_state resize_migrating.
Jun 26 02:48:47.892568 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:47.892922 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:47.987124 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:47.987396 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:48.067087 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:48:48.166033 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003992259998994996 future=<Future at 0x72e27c4acfe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:48.166656 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782442113.165534, 121ec5e6-08cf-4e0c-9c89-e2be23a274be => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:48.166862 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:48.167070 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] VM Stopped (Lifecycle Event)
Jun 26 02:48:48.167248 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.718113440999787 future=<Future at 0x72e27c2b36e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:48.167336 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.717983718999676 future=<Future at 0x72e27c2b36e0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:48.341505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:48.342074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:48.395585 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:48.670004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 121ec5e6-08cf-4e0c-9c89-e2be23a274be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:48.846494 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:48.885195 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:48.885689 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.46 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:48:48.904348 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.628s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:48.904624 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:48.906041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.591s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:48.993591 np0000003683 nova-compute[98991]: INFO nova.network.neutron [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating port 389ac5ac-04ef-4796-b021-984e9d1f73cd with attributes {'binding:host_id': 'np0000003683', 'device_owner': 'compute:nova'}
Jun 26 02:48:49.076209 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:48:49.095751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:49.095902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:49.096401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:49.566541 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:49.566743 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:49.621667 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:49.621765 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:49.621927 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:49.667836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:49.667836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing instance network info cache due to event network-changed-389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:48:49.667836 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] Acquiring lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:49.854491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:50.069220 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:50.101649 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:50.123896 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:50.170592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:48:50.170696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:50.170813 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:48:50.345581 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:50.413993 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:50.558442 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:50.577441 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.671s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:50.669996 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Deleted allocations for instance 05f1b3fb-23f5-44a0-8598-1dc4be523f89
Jun 26 02:48:50.672467 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:50.853129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:50.853129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:50.853129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:50.853129 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:48:50.891428 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:51.017678 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:51.022499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:51.022781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:51.023146 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attaching volume bf510188-22e5-49c2-b59d-6f15cd6bf204 to /dev/vdb
Jun 26 02:48:51.060249 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:51.061368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:48:51.062722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] Acquired lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:48:51.062722 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Refreshing network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:48:51.063579 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating image(s)
Jun 26 02:48:51.064953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:51.066086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:51.066086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:51.066086 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:51.070941 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:51.084899 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:51.115411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:51.161905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:51.162471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:51.170946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:51.173505 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c'] 
Jun 26 02:48:51.173505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:51.173505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:51.173505 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:51.173764 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating existing volume attachment record: 00c8fd78-25f7-4adc-bb41-1d386b5c9416 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:48:51.207041 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:51.570527 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:51.574732 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:51.574732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:51.574732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:51.688811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ac717633-6fcc-40d0-8e27-8d9ed3f73f9f tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Lock "05f1b3fb-23f5-44a0-8598-1dc4be523f89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.690s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:51.710323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:51.769090 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:51.770510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:51.770510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:51.770510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:51.770781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:51.786436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:51.786894 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:51.787120 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:51.787652 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:51.791547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:51.791729 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:51.804440 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:51.804440 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:51.811506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:48:51.811506 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204] added
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:51.815566 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:51.815826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:51.816011 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:51.816215 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204] added
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:48:51.824236 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:51.824613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:48:51.824613 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:48:51.824708 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:48:51.902683 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:51.903755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:51.905458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:51.909346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:51.988827 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:52.014449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.014449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.087129 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:52.122107 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.122107 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:52.127661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.221514 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:52.237089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:48:52.244968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.246109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.278465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.300562 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updated VIF entry in instance network info cache for port 389ac5ac-04ef-4796-b021-984e9d1f73cd. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:48:52.302360 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:48:52.322179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:48:52.322324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:48:52.331855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:48:52.333126 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c'] 
Jun 26 02:48:52.334803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:48:52.334803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:48:52.334803 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:52.346185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.349927 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:48:52.354954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.447716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.448819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.653728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.658159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.758975 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:52.765822 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:52.766310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.766757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.767203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.811419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2757c0d-c61c-423d-8b44-0a83f5243fbd req-0606de47-17c9-4dbd-a692-7a70ecf77936 service nova] Releasing lock "refresh_cache-e6978931-a3e5-47b1-8d77-29481b046155" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:48:52.816979 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:52.826960 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:52.836222 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:52.845867 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.851669 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.860858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.862204 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.part --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.862914 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] 08522427-36de-4852-a996-558b69cd33b8 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:48:52.863659 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:48:52.864031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.part /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.881814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.884803 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.885252 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.887590 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.887964 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:52.893512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:52.941221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.50.100,3260]
Jun 26 02:48:52.941221 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.50.100,3260] successful.
Jun 26 02:48:52.941221 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.957267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.968183 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.40.100,3260]
Jun 26 02:48:52.968183 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.40.100,3260] successful.
Jun 26 02:48:52.968183 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.980309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:52.981057 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:52.984119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:52.984634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:52.987176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('16', '-', '-', 0) found on session 100 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:52.987176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:52.989345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:53.017790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 100 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:53.017790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:53.017790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.017790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:53.041885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:53.042352 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:53.043591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.257s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:53.043858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:53.046032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('17', '-', '-', 0) found on session 101 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:53.046244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:53.069247 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 101 and hctl ['17', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:53.126277 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.134615 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:53.135810 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.172968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.part /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.converted" returned: 0 in 0.308s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.197784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.198606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.199143 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=49390MB free_disk=73.32672500610352GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:48:53.199723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:53.200055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:53.295027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a.converted --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.296007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.722s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:53.296884 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:53.301341 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:53.303009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.411663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json" returned: 0 in 0.108s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.412195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:53.412815 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:53.413426 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:53.418985 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:48:53.418985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.514782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.516066 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a,backing_fmt=raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.542585 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Starting finish_migration {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}}
Jun 26 02:48:53.544682 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:48:53.544842 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Creating image(s)
Jun 26 02:48:53.546411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.579211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a,backing_fmt=raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk 1073741824" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.579967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e80c46265fc9b8d6109e35ba3842e85750ce9a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:53.580782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.657468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.658473 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:48:53.658926 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:53.672099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e80c46265fc9b8d6109e35ba3842e85750ce9a4a --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.673448 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'migration_context' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:53.750962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:53.751671 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:48:54.070228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 101 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:54.070536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:54.177396 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:54.178007 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Rebasing disk image.
Jun 26 02:48:54.178350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:54.235396 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Applying migration context for instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 as it has an incoming, in-progress migration c080da60-adbe-4862-b2d8-64e733a9b739. Migration status is post-migrating {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 26 02:48:54.239258 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating resource usage from migration c080da60-adbe-4862-b2d8-64e733a9b739
Jun 26 02:48:54.254256 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:48:54.254607 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Ensure instance console log exists: /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:54.255052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:54.255353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:54.255558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:54.259207 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start _get_guest_xml network_info=[{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'be796a65-2602-4fa4-8bc5-2efa9ae032eb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '2f7efbb6-021e-4bc3-a514-f21f96d3ff29', 'attached_at': '2026-06-26T02:48:52.000000', 'detached_at': '', 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'multiattach': True, 'serial': '30e69043-4f4b-47f3-b252-4718d5d2e28b'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:54.268199 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:54.269636 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='2f7efbb6-021e-4bc3-a514-f21f96d3ff29'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442134.2691255) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:54.272170 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:54.272679 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:54.274491 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:54.274771 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:54.276019 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:54.276488 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:54.276710 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:54.276912 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:54.277354 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:54.277354 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:54.277354 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:54.277625 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:54.277782 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:54.277960 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:54.278131 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:54.278333 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:54.296666 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:54.321241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.142s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:54.321693 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.321917 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322089 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 438d9a42-bd81-4489-8c87-68f146dfc61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322414 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance b791619a-facd-4781-a2c8-84641e233b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322513 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance f0c513bb-680e-44fa-a657-c22de6578b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322664 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ecba11d0-cb36-45bd-afce-8a4a2666c369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322808 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 126a33da-d066-4fbf-bb4c-5da1f41252ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.322946 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Migration c080da60-adbe-4862-b2d8-64e733a9b739 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 26 02:48:54.323082 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.323206 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance e6978931-a3e5-47b1-8d77-29481b046155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:48:54.323723 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:48:54.323960 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2496MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:48:53 up 35 min,  2 users,  load average: 8.07, 7.09, 4.12\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_f2b74afe940c40d490cd930d9056fc92': '5', 'io_workload': '0', 'num_task_resize_finish': '1', 'num_proj_b8f9aa2fcf774b1f83232b3613d4c444': '1', 'num_proj_addc661d189b4a8c8e130200e4d2c30a': '1', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_8a7eadbb081143fb8f96d0187a0f7c09': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:48:54.329252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 -F raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:54.398591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:54.399188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:54.399535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:54.400042 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:54.400505 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:48:54.400863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:48:54.401012 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:54.817579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found WWN 3300000007a99d1cf for multipath device dm-10 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:54.818319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:54.818530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '3300000007a99d1cf', 'path': '/dev/dm-10', 'multipath_id': '3300000007a99d1cf'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:54.818690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a99d1cf', 'path': '/dev/dm-10', 'multipath_id': '3300000007a99d1cf'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:54.821173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.420s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:54.821579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:48:54.823215 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:54.833777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:54.834511 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:48:54.835093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:54.835336 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:48:54.835823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:48:54.836047 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:48:54.848689 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:48:54.849270 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:54.851181 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:48:54.860400 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:54.866010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:54.873371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('9', '0', '0', 0) found on session 92 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:54.885793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:54.895155 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 92 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:54.895155 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:54.896092 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash)
Jun 26 02:48:54.896372 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:48:54.897355 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:54.897355 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:48:54.897934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('10', '0', '0', 0) found on session 93 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:48:54.898048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:48:54.906628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 93 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:48:54.906795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:48:55.330251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attempting to attach volume bf510188-22e5-49c2-b59d-6f15cd6bf204 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:   <alias name="ua-bf510188-22e5-49c2-b59d-6f15cd6bf204"/>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:   <serial>bf510188-22e5-49c2-b59d-6f15cd6bf204</serial>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:48:55.331845 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:48:55.338718 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 -F raw /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk" returned: 0 in 1.010s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:55.339078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:48:55.339244 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Ensure instance console log exists: /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:48:55.339503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:55.339680 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:55.339806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:55.341235 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start _get_guest_xml network_info=[{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='ded1f265eb0dfef330a0793b79de757a',container_format='bare',created_at=2026-06-26T02:48:27Z,direct_url=<?>,disk_format='qcow2',id=08522427-36de-4852-a996-558b69cd33b8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1484249249-shelved',owner='8a7eadbb081143fb8f96d0187a0f7c09',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-26T02:48:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:48:55.344465 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:48:55.345602 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1484249249', uuid='e6978931-a3e5-47b1-8d77-29481b046155'), owner=OwnerMeta(userid='b7340727e31547a4b39299401535770d', username='tempest-AttachVolumeShelveTestJSON-100564320-project-member', projectid='8a7eadbb081143fb8f96d0187a0f7c09', projectname='tempest-AttachVolumeShelveTestJSON-100564320'), image=ImageMeta(id='08522427-36de-4852-a996-558b69cd33b8', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442135.3452225) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:48:55.347488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:48:55.347798 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:48:55.349138 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:48:55.349314 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:48:55.350225 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:48:55.350589 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ded1f265eb0dfef330a0793b79de757a',container_format='bare',created_at=2026-06-26T02:48:27Z,direct_url=<?>,disk_format='qcow2',id=08522427-36de-4852-a996-558b69cd33b8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1484249249-shelved',owner='8a7eadbb081143fb8f96d0187a0f7c09',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-26T02:48:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:48:55.350728 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:48:55.350830 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:48:55.350949 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:48:55.351030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:48:55.351116 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:48:55.351257 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:48:55.351392 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:48:55.351544 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:48:55.351646 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:48:55.351764 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:48:55.351906 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:55.353809 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:48:55.836885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:48:55.855099 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:55.868701 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:48:55.868996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.669s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:55.871379 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:48:55.873981 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='08522427-36de-4852-a996-558b69cd33b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-111261166',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:47Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:48:34.700189',shelved_host='np0000003683',shelved_image_id='08522427-36de-4852-a996-558b69cd33b8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:55.874188 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:55.875008 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:55.875742 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'pci_devices' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:55.887428 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.002071763000003557 future=<Future at 0x72e27c2b36e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:55.887784 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:55.889377 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.991536707999785 future=<Future at 0x72e27c5e66c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:55.889549 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.991334951999761 future=<Future at 0x72e27c5e66c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:48:55.890027 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] Emitting event <LifecycleEvent: 1782442120.88522, 05f1b3fb-23f5-44a0-8598-1dc4be523f89 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:48:55.890269 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] VM Stopped (Lifecycle Event)
Jun 26 02:48:55.892445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.377777 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <uuid>e6978931-a3e5-47b1-8d77-29481b046155</uuid>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <name>instance-0000002a</name>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1484249249</nova:name>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:55</nova:creationTime>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:user uuid="b7340727e31547a4b39299401535770d">tempest-AttachVolumeShelveTestJSON-100564320-project-member</nova:user>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:project uuid="8a7eadbb081143fb8f96d0187a0f7c09">tempest-AttachVolumeShelveTestJSON-100564320</nova:project>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         <nova:port uuid="389ac5ac-04ef-4796-b021-984e9d1f73cd">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="serial">e6978931-a3e5-47b1-8d77-29481b046155</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="uuid">e6978931-a3e5-47b1-8d77-29481b046155</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:41:f9:6f"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <target dev="tap389ac5ac-04"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/console.log" append="off"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:56.378858 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Preparing to wait for external event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='08522427-36de-4852-a996-558b69cd33b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-111261166',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:47Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member',shelved_at='2026-06-26T02:48:34.700189',shelved_host='np0000003683',shelved_image_id='08522427-36de-4852-a996-558b69cd33b8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.382444 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:56.383718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:56.383718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.383921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd292536-b97b-52e2-90d8-16dcd9df377b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:56.384835 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.385612 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:56.390340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.392808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.393012 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap389ac5ac-04, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:56.393563 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap389ac5ac-04, col_values=(('qos', UUID('f95e8107-dbd6-404b-aa2d-3ec17b45e149')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:56.393563 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap389ac5ac-04, col_values=(('external_ids', {'iface-id': '389ac5ac-04ef-4796-b021-984e9d1f73cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f9:6f', 'vm-uuid': 'e6978931-a3e5-47b1-8d77-29481b046155'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:56.394258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.395678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:56.397591 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-89599e2e-0d71-40d1-ae5d-37e19b5563f1 tempest-ImageDependencyTests-1109640317 tempest-ImageDependencyTests-1109640317-project-member] [instance: 05f1b3fb-23f5-44a0-8598-1dc4be523f89] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:48:56.403222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:56.404587 np0000003683 nova-compute[98991]: INFO os_vif [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04')
Jun 26 02:48:56.853993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000007341c2f6 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:48:56.854421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:48:56.854421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (2453ms) {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:48:56.854610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:48:56.988905 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.010078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:57.010206 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:57.010344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:57.010492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No VIF found with MAC fa:16:3e:07:6d:30, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:57.362638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:53Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:48:57.362843 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:57.363443 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <uuid>2f7efbb6-021e-4bc3-a514-f21f96d3ff29</uuid>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <name>instance-0000002b</name>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <memory>262144</memory>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-0</nova:name>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:48:54</nova:creationTime>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.micro" id="84">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:memory>256</nova:memory>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         <nova:port uuid="c7cfe23d-16e2-4912-8b79-2d44cb60e8c5">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="serial">2f7efbb6-021e-4bc3-a514-f21f96d3ff29</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="uuid">2f7efbb6-021e-4bc3-a514-f21f96d3ff29</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk.config"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <shareable/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:a6:ed:f4"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <target dev="tapc7cfe23d-16"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/console.log" append="off"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:48:57.365104 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:53Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:a6:ed:f4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.368537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8249224c-7e59-5aa1-8d51-33484ef2a36a', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:57.384496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.384496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:57.387400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.391985 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.392298 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7cfe23d-16, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:57.392722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7cfe23d-16, col_values=(('qos', UUID('5d5c027e-0e77-482e-b4e5-7564f4dd242a')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:57.392907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7cfe23d-16, col_values=(('external_ids', {'iface-id': 'c7cfe23d-16e2-4912-8b79-2d44cb60e8c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:ed:f4', 'vm-uuid': '2f7efbb6-021e-4bc3-a514-f21f96d3ff29'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:48:57.394412 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.396696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:48:57.403726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:57.404856 np0000003683 nova-compute[98991]: INFO os_vif [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16')
Jun 26 02:48:57.867424 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.868222 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.868469 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.868847 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.869270 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.869730 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:48:57.869970 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:48:57.870212 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.47 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:48:57.947058 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:57.947357 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:57.947560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] No VIF found with MAC fa:16:3e:41:f9:6f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:57.948224 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Using config drive
Jun 26 02:48:58.450937 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'ec2_ids' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:58.575871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-690f5cf6-e4f0-413a-a66e-ca8957e90cad tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.553s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:58.931586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:58.931586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:58.931586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:48:58.931586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:a6:ed:f4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:48:58.932195 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Using config drive
Jun 26 02:48:58.954038 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:58.954219 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'keypairs' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:48:59.294737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:59.295104 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:59.360254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:59.400895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:59.456647 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Object Instance<e6978931-a3e5-47b1-8d77-29481b046155> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:48:59.459369 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:48:59.508522 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:59.530170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:59.536096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:48:59.556857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:48:59.557462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:48:59.560498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:48:59.560498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:48:59.560498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:48:59.560498 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d16b3e75-f64c-47da-b67c-fc63c1c386ac req-bb036db6-98b6-48bd-a0f2-778810f31223 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received unexpected event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with vm_state active and task_state resize_finish.
Jun 26 02:48:59.620743 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Creating config drive at /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config
Jun 26 02:48:59.624631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp61sii_p9 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:48:59.679781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp61sii_p9" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:48:59.800778 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:00.079260 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.108195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.199382 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.205040 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 due to new event <LifecycleEvent: 1782442140.204225, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:49:00.205040 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442140.204225, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:00.205200 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Resumed (Lifecycle Event)
Jun 26 02:49:00.206419 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:49:00.210874 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance running successfully.
Jun 26 02:49:00.216517 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Failed to set time: agent not configured {{(pid=98991) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 26 02:49:00.216734 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8e7f2e60-d813-484a-abe1-de644ec864b0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] finish_migration finished successfully. {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}}
Jun 26 02:49:00.451186 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.453855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.461501 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.481554 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:00.708379 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:00.711574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:00.808400 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:00.881350 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00041446100021858 future=<Future at 0x72e27c5e66c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:00.881453 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:01.216205 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 26 02:49:01.216205 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442141.2152157, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:01.216205 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Started (Lifecycle Event)
Jun 26 02:49:01.632687 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:01.640976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:01.641228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:01.641404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:01.644011 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:01.644237 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received unexpected event network-vif-plugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with vm_state resized and task_state None.
Jun 26 02:49:01.644423 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:01.644635 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:01.644823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:01.644994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:01.645166 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Processing event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:49:01.645459 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:01.646523 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:49:01.646734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:01.646928 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:01.647082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:01.647255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] No waiting events found dispatching network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:01.647829 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9153930c-eac5-4845-8c9c-934e901d430c req-6cf246c4-a750-4f42-97cf-02b55670548d service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received unexpected event network-vif-plugged-389ac5ac-04ef-4796-b021-984e9d1f73cd for instance with vm_state shelved_offloaded and task_state spawning.
Jun 26 02:49:01.650715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:49:01.653381 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance spawned successfully.
Jun 26 02:49:01.718671 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:01.724328 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:01.870114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:01.870252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:01.870463 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attaching volume 4908758e-df4e-41d6-9f1e-6858767334db to /dev/vdc
Jun 26 02:49:01.925621 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:01.939502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:49:01.962325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:01.994499 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:02.008299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:49:02.008739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:49:02.020454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:49:02.022394 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865'] 
Jun 26 02:49:02.022739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:49:02.022908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:49:02.023296 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:02.023675 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating existing volume attachment record: cd5194e3-c2bb-4c28-9488-5302a9c6ca99 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:49:02.086612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:02.226411 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442142.225991, e6978931-a3e5-47b1-8d77-29481b046155 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:02.226625 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Started (Lifecycle Event)
Jun 26 02:49:02.413311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:02.577518 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:49:02.577829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:02.578032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:02.578508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:02.578851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:49:02.596860 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:02.597875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:02.598637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:02.598886 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:02.599729 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46d4401c-654d-4fba-b46d-dca7473e6ae6 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.387s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:02.600532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:02.601533 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:02.611061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:02.611061 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:02.616877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:02.616877 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db] added
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:02.627190 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:02.627452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:02.627591 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:02.627900 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db] added
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:02.628147 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:02.628357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:02.628396 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:02.628554 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:02.693939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:02.694377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:02.694377 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Going to confirm migration 3 {{(pid=98991) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 26 02:49:02.729426 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:02.731248 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:03.208315 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:03.233869 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442143.2334676, e6978931-a3e5-47b1-8d77-29481b046155 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:03.234030 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Paused (Lifecycle Event)
Jun 26 02:49:03.308901 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:03.309565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:03.309697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:03.309895 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:03.310053 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'info_cache' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:03.628439 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:03.628981 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:03.640711 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:03.647181 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.655719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.661872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.673360 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.673788 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.678499 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.678828 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:03.713570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.40.100,3260]
Jun 26 02:49:03.713570 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:03.713570 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.727551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.736509 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:03.738583 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442143.738362, e6978931-a3e5-47b1-8d77-29481b046155 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:03.739066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.50.100,3260]
Jun 26 02:49:03.739066 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:03.739066 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.739344 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Resumed (Lifecycle Event)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.747565 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.747890 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:03.748108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:03.748108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:03.749095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('15', '-', '-', 0) found on session 102 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:03.749401 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:03.755623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:03.768205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 102 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:03.768205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.776543 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:03.776788 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:03.777032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:03.777151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:03.778317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] HCTL ('18', '-', '-', 0) found on session 103 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:03.778445 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:03.797005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Searching for a device in session 103 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:03.797005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:04.246514 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:04.249109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:04.318857 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:04.600736 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:49:04.621605 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:04.777323 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:05.279954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:05.280163 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'migration_context' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:05.616540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found WWN 330000000ff9d57ed for multipath device dm-11 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:49:05.616873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:05.617110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000ff9d57ed', 'path': '/dev/dm-11', 'multipath_id': '330000000ff9d57ed'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:05.617320 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ff9d57ed', 'path': '/dev/dm-11', 'multipath_id': '330000000ff9d57ed'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:49:05.619835 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:05.782576 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Object Instance<2f7efbb6-021e-4bc3-a514-f21f96d3ff29> lazy-loaded attributes: info_cache,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:49:05.790175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:05.790469 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:06.123010 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attempting to attach volume 4908758e-df4e-41d6-9f1e-6858767334db with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:   <alias name="ua-4908758e-df4e-41d6-9f1e-6858767334db"/>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-11"/>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:   <serial>4908758e-df4e-41d6-9f1e-6858767334db</serial>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:06.124984 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:49:06.794690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:06.795049 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:06.994630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:07.298245 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:07.416408 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:07.771942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:07.772084 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:07.772133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:07.772238 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:07.772337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] No VIF found with MAC fa:16:3e:07:6d:30, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:49:08.311167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.521s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:08.951183 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocation for migration c080da60-adbe-4862-b2d8-64e733a9b739
Jun 26 02:49:09.332977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d0338595-2683-4641-beeb-63557436a302 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.463s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:09.455847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c85cbf95-addd-4437-8502-63412a0bdb60 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.762s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:11.140639 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:11.141109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing instance network info cache due to event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:11.141307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:11.141429 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:11.141578 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:11.645197 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:11.997609 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:12.007135 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:12.159908 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updated VIF entry in instance network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:12.160251 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:12.418156 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:12.662766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ebdde439-85e4-47bb-8c9d-db7022701cb7 req-c6fe8cbc-826d-4b38-843f-06d4fd93add0 service nova] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:13.220237 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:13.220677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing instance network info cache due to event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:13.220677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:13.220888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:13.220888 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:13.723555 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:14.110397 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:14.274613 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updated VIF entry in instance network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:14.277598 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:14.779810 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-49939c23-6e52-4136-8500-d5520fdd426e req-0e5c993c-bd99-47de-86ac-a87afb4057af service nova] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:15.203307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:15.203505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:15.706164 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Detaching volume bf510188-22e5-49c2-b59d-6f15cd6bf204
Jun 26 02:49:15.757456 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attempting to driver detach volume bf510188-22e5-49c2-b59d-6f15cd6bf204 from mountpoint /dev/vdb
Jun 26 02:49:15.763887 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found disk vdb by alias ua-bf510188-22e5-49c2-b59d-6f15cd6bf204 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:49:15.765302 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found disk vdb by alias ua-bf510188-22e5-49c2-b59d-6f15cd6bf204 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:49:15.765458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Attempting to detach device vdb from instance b791619a-facd-4781-a2c8-84641e233b95 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <alias name="ua-bf510188-22e5-49c2-b59d-6f15cd6bf204"/>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <serial>bf510188-22e5-49c2-b59d-6f15cd6bf204</serial>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:15.765737 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:49:15.773047 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully detached device vdb from instance b791619a-facd-4781-a2c8-84641e233b95 from the persistent domain config.
Jun 26 02:49:15.773360 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] (1/8): Attempting to detach device vdb with device alias ua-bf510188-22e5-49c2-b59d-6f15cd6bf204 from instance b791619a-facd-4781-a2c8-84641e233b95 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <alias name="ua-bf510188-22e5-49c2-b59d-6f15cd6bf204"/>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-10"/>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <serial>bf510188-22e5-49c2-b59d-6f15cd6bf204</serial>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:15.773666 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:49:15.899086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:15.899677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:16.290933 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442156.2905335, b791619a-facd-4781-a2c8-84641e233b95 => ua-bf510188-22e5-49c2-b59d-6f15cd6bf204> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:49:16.292636 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bf510188-22e5-49c2-b59d-6f15cd6bf204 for instance b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:49:16.295547 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully detached device vdb from instance b791619a-facd-4781-a2c8-84641e233b95 from the live domain config.
Jun 26 02:49:16.296707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:49:16.297101 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:16.297285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:16.297696 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:16.297986 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bf510188-22e5-49c2-b59d-6f15cd6bf204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:49:16.298111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:16.326995 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:16.327444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:49:16.327767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '101')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:16.328928 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '100')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:16.330460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a2340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:49:16.330717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Removing multipathed devices sdl, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:49:16.331091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Flush multipath device 3300000007a99d1cf {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:49:16.358437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:16.401016 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:49:16.427336 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:16.480988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if SCSI volumes sdl, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:49:16.481184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] SCSI volumes sdl, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:49:16.483328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if device paths {'sdl', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:49:16.497048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Device paths {'sdl', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:49:16.498371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:49:16.510862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.558403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.40.100,3260]
Jun 26 02:49:16.558403 np0000003683 nova-compute[98991]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:16.558403 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.581521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.596004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.644195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.50.100,3260]
Jun 26 02:49:16.644195 np0000003683 nova-compute[98991]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:16.644195 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.667077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:16.667077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:16.667077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== disconnect_volume: return (367ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:16.667077 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:49:16.946838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:16.947148 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:16.950291 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:49:16.950512 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Claim successful on node np0000003683
Jun 26 02:49:16.999602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:17.225216 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:17.431963 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:18.231763 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c544304-b811-4759-9ac8-29ef27f61a15 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.028s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:18.533890 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:18.534543 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:19.037217 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:19.544324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.597s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:19.544756 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:49:20.051647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:49:20.052151 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:49:20.052514 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:20.053710 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:20.137674 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dabf44f7bd7d4f0bb60de94c0db9de53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addc661d189b4a8c8e130200e4d2c30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:49:20.556430 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:49:20.704122 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Successfully created port: 6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:49:21.061744 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:49:21.261432 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Successfully updated port: 6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:49:21.313987 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-changed-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:21.313987 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Refreshing instance network info cache due to event network-changed-6efff377-57b3-4a30-97d4-923d2bf80ecb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:21.313987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] Acquiring lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:21.314134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] Acquired lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:21.314634 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Refreshing network info cache for port 6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:21.567138 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Booting with volume 555c825b-3548-4ec8-8930-0d78ce99c578 at /dev/vda
Jun 26 02:49:21.614283 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:21.626433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:49:21.651092 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:21.705115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:49:21.705115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:49:21.716437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:49:21.717719 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865'] 
Jun 26 02:49:21.719525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:49:21.719525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:49:21.719525 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:21.719525 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updating existing volume attachment record: 4d06b884-fc35-4b2b-98e2-73c591d5569f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:49:21.763940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:21.819852 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:21.895554 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:49:22.000512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:22.039281 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:22.356225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:22.356225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:22.432768 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:22.542370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6d88481b-6c68-4308-a6a2-252ed8221b5f req-f34c4393-ddc8-426c-b22e-93a507010ad4 service nova] Releasing lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:22.542878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquired lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:22.543083 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:22.859354 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:23.121579 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:49:23.264358 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:23.335099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:23.335099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:23.392831 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updating instance_info_cache with network_info: [{"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:23.823534 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:49:23.824803 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:49:23.825067 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Creating image(s)
Jun 26 02:49:23.825406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:49:23.825556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Ensure instance console log exists: /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:49:23.825803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:23.825954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:23.826075 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:23.837498 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Detaching volume 4908758e-df4e-41d6-9f1e-6858767334db
Jun 26 02:49:23.864899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:23.888265 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Attempting to driver detach volume 4908758e-df4e-41d6-9f1e-6858767334db from mountpoint /dev/vdc
Jun 26 02:49:23.894889 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Releasing lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:23.895339 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance network_info: |[{"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:49:23.895958 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Start _get_guest_xml network_info=[{"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d06b884-fc35-4b2b-98e2-73c591d5569f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '34177e20-827a-4fcf-a802-1e99eee882e5', 'attached_at': '', 'detached_at': '', 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'serial': '555c825b-3548-4ec8-8930-0d78ce99c578'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:49:23.897080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found disk vdc by alias ua-4908758e-df4e-41d6-9f1e-6858767334db {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:49:23.898968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Found disk vdc by alias ua-4908758e-df4e-41d6-9f1e-6858767334db {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:49:23.899147 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Attempting to detach device vdc from instance b791619a-facd-4781-a2c8-84641e233b95 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <alias name="ua-4908758e-df4e-41d6-9f1e-6858767334db"/>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-11"/>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <serial>4908758e-df4e-41d6-9f1e-6858767334db</serial>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:23.899491 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:49:23.900059 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:49:23.901532 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-566755918', uuid='34177e20-827a-4fcf-a802-1e99eee882e5'), owner=OwnerMeta(userid='dabf44f7bd7d4f0bb60de94c0db9de53', username='tempest-TestVolumeBootPatternV346-766983106-project-member', projectid='addc661d189b4a8c8e130200e4d2c30a', projectname='tempest-TestVolumeBootPatternV346-766983106'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442163.9010797) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:49:23.902753 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:49:23.903611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:49:23.904398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:49:23.904721 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:49:23.905624 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:49:23.905874 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:49:23.906008 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:49:23.906099 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:49:23.906220 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:49:23.906309 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:49:23.906403 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:49:23.906570 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:49:23.906676 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:49:23.906784 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:49:23.906882 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:49:23.906992 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:49:23.917940 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully detached device vdc from instance b791619a-facd-4781-a2c8-84641e233b95 from the persistent domain config.
Jun 26 02:49:23.918049 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] (1/8): Attempting to detach device vdc with device alias ua-4908758e-df4e-41d6-9f1e-6858767334db from instance b791619a-facd-4781-a2c8-84641e233b95 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <alias name="ua-4908758e-df4e-41d6-9f1e-6858767334db"/>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-11"/>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <serial>4908758e-df4e-41d6-9f1e-6858767334db</serial>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:23.918382 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:49:23.920299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:49:23.920649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:23.920811 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:24.447894 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442164.4475813, b791619a-facd-4781-a2c8-84641e233b95 => ua-4908758e-df4e-41d6-9f1e-6858767334db> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:49:24.448910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-4908758e-df4e-41d6-9f1e-6858767334db for instance b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:49:24.450915 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully detached device vdc from instance b791619a-facd-4781-a2c8-84641e233b95 from the live domain config.
Jun 26 02:49:24.451886 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:49:24.452168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:24.452283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:24.937613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:24.937613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:24.938223 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attaching volume 54b441cb-7c4b-4d93-9731-7cd9bdc79018 to /dev/vdb
Jun 26 02:49:25.000019 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:25.011684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:49:25.035148 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:25.082599 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:49:25.082998 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:49:25.093414 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:49:25.095312 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865'] 
Jun 26 02:49:25.095457 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:49:25.095810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:49:25.096164 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:25.096632 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating existing volume attachment record: 49c59648-9555-4acc-b944-a01f73c6d01f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:49:25.175037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.254s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:25.175439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:49:25.193809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:25.194647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:25.195232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:25.195485 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:25.196004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:25.196327 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:25.207937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:25.207937 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:25.211507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:25.211507 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578] added
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:25.222802 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:25.223118 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:25.223356 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:25.223412 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578] added
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:25.227538 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:25.227779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:25.228037 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:25.228270 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:25.692526 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:49:25.696285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:49:25.696858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:25.696951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:26.223830 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:26.229019 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:26.246802 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:26.254816 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.258823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.269270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.279888 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.280297 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.293848 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.294207 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:26.333084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.40.100,3260]
Jun 26 02:49:26.333084 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:26.333084 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.358324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.359011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.50.100,3260]
Jun 26 02:49:26.359011 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:26.359011 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.376638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.381997 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.382421 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:26.382682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:26.382748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:26.384837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('17', '-', '-', 0) found on session 106 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:26.384972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.395443 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:26.395845 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:26.396068 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:26.396135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:26.398132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('19', '-', '-', 0) found on session 107 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:26.398427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:26.403788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 106 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:26.404003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:26.413334 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 107 and hctl ['19', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:27.005820 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:27.411336 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 107 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:27.411886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:27.434744 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:28.225797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Found WWN 3300000009d62209b for multipath device dm-10 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:49:28.226660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:28.226902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== connect_volume: return (4306ms) {'type': 'block', 'scsi_wwn': '3300000009d62209b', 'path': '/dev/dm-10', 'multipath_id': '3300000009d62209b'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:28.227043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d62209b', 'path': '/dev/dm-10', 'multipath_id': '3300000009d62209b'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:49:28.227729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.774s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:28.228244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4908758e-df4e-41d6-9f1e-6858767334db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:49:28.228404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:28.269836 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:49:28.270386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '102')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:28.271793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '103')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:28.276293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4d2a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'): ({'sdm'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:49:28.276664 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Removing multipathed devices sdj, sdm {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:49:28.276975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Flush multipath device 330000000ff9d57ed {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:49:28.312286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:28.372835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:28.430993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if SCSI volumes sdj, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:49:28.431455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] SCSI volumes sdj, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:49:28.432870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if device paths {'sdj', 'sdm'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:49:28.446461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Device paths {'sdj', 'sdm'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:49:28.446767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:49:28.462071 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.515795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.40.100,3260]
Jun 26 02:49:28.515795 np0000003683 nova-compute[98991]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:28.515795 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.540104 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.553607 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.601501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.50.100,3260]
Jun 26 02:49:28.601501 np0000003683 nova-compute[98991]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:28.601501 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.623198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.623463 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:28.623609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== disconnect_volume: return (4170ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:28.623738 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:49:28.624350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.927s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:28.624641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:49:28.643468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:28.644319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:28.645179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:28.645523 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:28.646127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:28.646455 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:28.659441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:28.659441 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.664236 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:49:28.664236 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:28.685096 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.685510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:28.685672 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:28.685860 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:49:28.691828 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:28.692090 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:49:28.692184 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:49:28.692357 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:49:28.737315 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-566755918',display_name='tempest-TestVolumeBootPatternV346-server-566755918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-566755918',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxHK/d7armTKa8/E7Aqbnif3s9IMhux2LUg1knN/HZbY/3w4Y/fj1bGtbyvrGmU4LYIJoE83LK9HtXxiH6dZMqXYUq2DsnDvGbGTjOfGZBEAtpAJ91DwgOJPo5QEEHyw==',key_name='tempest-keypair-1599760236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-a2mgs7dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=34177e20-827a-4fcf-a802-1e99eee882e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:49:28.737678 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:28.738541 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:28.739399 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'pci_devices' on Instance uuid 34177e20-827a-4fcf-a802-1e99eee882e5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:29.198337 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'flavor' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <uuid>34177e20-827a-4fcf-a802-1e99eee882e5</uuid>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <name>instance-00000031</name>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPatternV346-server-566755918</nova:name>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:49:23</nova:creationTime>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:user uuid="dabf44f7bd7d4f0bb60de94c0db9de53">tempest-TestVolumeBootPatternV346-766983106-project-member</nova:user>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:project uuid="addc661d189b4a8c8e130200e4d2c30a">tempest-TestVolumeBootPatternV346-766983106</nova:project>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         <nova:port uuid="6efff377-57b3-4a30-97d4-923d2bf80ecb">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="serial">34177e20-827a-4fcf-a802-1e99eee882e5</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="uuid">34177e20-827a-4fcf-a802-1e99eee882e5</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/disk.config"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <alias name="ua-555c825b-3548-4ec8-8930-0d78ce99c578"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-10"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <serial>555c825b-3548-4ec8-8930-0d78ce99c578</serial>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:06:47:38"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <target dev="tap6efff377-57"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/console.log" append="off"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:49:29.242676 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:49:29.245067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Preparing to wait for external event network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:49:29.245067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:29.245067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:29.245067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:29.245276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-566755918',display_name='tempest-TestVolumeBootPatternV346-server-566755918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-566755918',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxHK/d7armTKa8/E7Aqbnif3s9IMhux2LUg1knN/HZbY/3w4Y/fj1bGtbyvrGmU4LYIJoE83LK9HtXxiH6dZMqXYUq2DsnDvGbGTjOfGZBEAtpAJ91DwgOJPo5QEEHyw==',key_name='tempest-keypair-1599760236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-a2mgs7dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=34177e20-827a-4fcf-a802-1e99eee882e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:49:29.245406 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:29.246017 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:29.246346 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:49:29.247901 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.248582 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:29.248972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:49:29.250596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.250862 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd21a91cb-4057-5bae-9a37-8ac380b1f73f', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:29.251924 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.252962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:29.253028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.257865 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.258212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6efff377-57, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:29.258754 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6efff377-57, col_values=(('qos', UUID('0490911f-cbfd-49f8-a519-8bcf91391f73')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:29.259421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6efff377-57, col_values=(('external_ids', {'iface-id': '6efff377-57b3-4a30-97d4-923d2bf80ecb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:47:38', 'vm-uuid': '34177e20-827a-4fcf-a802-1e99eee882e5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:29.260333 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.261966 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:29.268345 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:29.271063 np0000003683 nova-compute[98991]: INFO os_vif [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57')
Jun 26 02:49:29.686295 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:29.692847 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:29.711213 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:29.720040 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.726978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.734012 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.752437 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.752868 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.753610 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.753844 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:29.804416 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:49:29.804416 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:29.804416 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.816923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:49:29.816923 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:29.816923 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.817327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.831015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.840928 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.841385 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:29.841705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:29.841705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:29.842714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('15', '-', '-', 0) found on session 108 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:29.842839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:29.857498 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:29.858332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:29.858559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:29.859085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 108 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:29.859302 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:29.860654 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('18', '-', '-', 0) found on session 109 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:29.860768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:29.874214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 109 and hctl ['18', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:30.204687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ced28576-f55f-4cef-ac94-174b87ff4653 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.870s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:30.791342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:30.791790 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:30.791790 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No VIF found with MAC fa:16:3e:06:47:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:49:30.792228 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Using config drive
Jun 26 02:49:30.874238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 109 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:30.874468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:31.008837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:31.009594 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing instance network info cache due to event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:31.009820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:31.010063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:31.010196 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:31.297644 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:31.428068 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Creating config drive at /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/disk.config
Jun 26 02:49:31.433241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7j5yn43i {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:31.488600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7j5yn43i" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:31.512799 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:31.665762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 330000000844c6185 for multipath device dm-11 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:49:31.666190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:31.667776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (5970ms) {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000844c6185'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:31.667776 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000844c6185'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:49:31.670993 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:49:31.671190 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:49:31.671385 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:49:31.691920 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:49:31.692329 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:49:31.692512 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:49:31.692778 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:49:31.693450 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x72e27c3105c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'reserved', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:49:31.693596 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] formatting encrypted volume /dev/dm-11 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:49:31.831792 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:31.957059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:31.992599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.008020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.026978 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updated VIF entry in instance network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:32.027685 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:32.036748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:32.036748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:32.037209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:32.037209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:32.037209 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:32.039816 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Terminating instance
Jun 26 02:49:32.085116 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.129145 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.131491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.487552 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Stashing vm_state: active {{(pid=98991) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 26 02:49:32.529471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-326bebaf-4a28-4c73-918d-b38a7c635f2e req-7811b908-255f-4a34-85d0-fe25de0c6f5a service nova] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:32.545235 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:49:32.567108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.569574 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.595055 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.604564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.633709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.638455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:32.709192 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442172.7088854, 34177e20-827a-4fcf-a802-1e99eee882e5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:32.709449 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] VM Started (Lifecycle Event)
Jun 26 02:49:32.720674 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:32.720882 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:32.721052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:32.721174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:32.721318 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] No waiting events found dispatching network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:32.721431 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f956fa9f-ef52-4b05-96ee-eaae93203512 req-87bb0cc9-51f6-4398-ae21-568610ea874d service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:49:32.878964 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] Instance destroyed successfully.
Jun 26 02:49:32.880460 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lazy-loading 'resources' on Instance uuid b791619a-facd-4781-a2c8-84641e233b95 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:33.051041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:33.051226 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:33.080442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:33.080631 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing instance network info cache due to event network-changed-077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:33.080784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Acquiring lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:33.080900 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Acquired lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:33.081016 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Refreshing network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:33.212468 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:33.214127 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442173.213912, 34177e20-827a-4fcf-a802-1e99eee882e5 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:33.214238 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] VM Paused (Lifecycle Event)
Jun 26 02:49:33.382081 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1644809082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testinstanceswithcindervolumes-server-1644809082',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4aEtpswIY5sjfsQeCuY2gAUydzm7Q1NmgN9uh8iVObzT5Sy23esrp/oKaxgSH1qqjYDHiyias2uTN5ibJs1yBdexmKsEUPjkF/Gl8WEfn3OSx9bg73g+5TuybbvDoBMw==',key_name='tempest-TestInstancesWithCinderVolumes-379047694',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:07Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8f9aa2fcf774b1f83232b3613d4c444',ramdisk_id='',reservation_id='r-nv4keuk9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-722025130',owner_user_name='tempest-TestInstancesWithCinderVolumes-722025130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:48:07Z,user_data=None,user_id='92d1888271c9461994f3d8303bb1943d',uuid=b791619a-facd-4781-a2c8-84641e233b95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:49:33.382272 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converting VIF {"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:33.382866 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:33.383184 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:49:33.384578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:33.384831 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap077e020c-fd, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:33.385853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:33.386721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:33.387014 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:33.387775 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:33.387911 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee51bdfc-f575-4cfe-8b77-d1aa2deb9ffa) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:33.388485 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:33.389405 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:33.391027 np0000003683 nova-compute[98991]: INFO os_vif [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:6d:30,bridge_name='br-int',has_traffic_filtering=True,id=077e020c-fd5b-49cf-9804-87f57efbd930,network=Network(8702e29d-262b-4629-afc9-5f18e133696a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077e020c-fd')
Jun 26 02:49:33.392195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:49:33.392493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:33.392650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:33.392985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:33.393299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86546ce9-7ea0-4194-a7e8-e2ad73495e33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:49:33.393442 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:33.422983 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:33.423318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:49:33.423729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:33.424728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:33.425760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3cd760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:49:33.425970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:49:33.426199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Flush multipath device 3300000002090850c {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:49:33.492051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:33.537938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:33.561854 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:49:33.562318 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Claim successful on node np0000003683
Jun 26 02:49:33.588398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:49:33.588719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:49:33.589214 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:33.593057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:49:33.604914 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:49:33.605214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:49:33.619307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.655733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.40.100,3260]
Jun 26 02:49:33.655733 np0000003683 nova-compute[98991]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:33.655733 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.685797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.701956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.716581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:33.718751 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:33.743673 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.50.100,3260]
Jun 26 02:49:33.743673 np0000003683 nova-compute[98991]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:33.743673 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.766863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:33.766964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:33.767042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] <== disconnect_volume: return (374ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:33.767195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:49:33.767689 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Deleting instance files /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95_del
Jun 26 02:49:33.768280 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Deletion of /opt/stack/data/nova/instances/b791619a-facd-4781-a2c8-84641e233b95_del complete
Jun 26 02:49:33.933468 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:34.068441 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating resource usage from migration d42c3101-4d72-453e-b4b3-f08e4bbc352e
Jun 26 02:49:34.072894 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updated VIF entry in instance network info cache for port 077e020c-fd5b-49cf-9804-87f57efbd930. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:34.073548 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [{"id": "077e020c-fd5b-49cf-9804-87f57efbd930", "address": "fa:16:3e:07:6d:30", "network": {"id": "8702e29d-262b-4629-afc9-5f18e133696a", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-256596475-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b8f9aa2fcf774b1f83232b3613d4c444", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap077e020c-fd", "ovs_interfaceid": "077e020c-fd5b-49cf-9804-87f57efbd930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:34.223001 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:49:34.223373 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999794156999997 future=<Future at 0x72e29c3a9970 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:34.223600 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999542608999946 future=<Future at 0x72e29c3a9970 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:34.223675 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999451709999903 future=<Future at 0x72e29c3a9970 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:34.290753 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Took 1.74 seconds to destroy the instance on the hypervisor.
Jun 26 02:49:34.293799 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:49:34.293799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:49:34.294519 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:49:34.294519 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:34.429643 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:34.579000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Releasing lock "refresh_cache-b791619a-facd-4781-a2c8-84641e233b95" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:34.579205 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:34.579381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:34.579712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:34.579712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:34.579834 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Processing event network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:49:34.580034 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:34.580402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:34.580809 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:49:34.581309 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:34.581611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:34.581611 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] No waiting events found dispatching network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:34.581770 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c6919d7a-c3c2-4cd7-8637-c41ffddd2eb8 req-f9dca6be-ae4e-4dbd-a326-fb385e24506c service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received unexpected event network-vif-plugged-6efff377-57b3-4a30-97d4-923d2bf80ecb for instance with vm_state building and task_state spawning.
Jun 26 02:49:34.583690 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442174.5833063, 34177e20-827a-4fcf-a802-1e99eee882e5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:34.583943 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] VM Resumed (Lifecycle Event)
Jun 26 02:49:34.585232 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:49:34.587789 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance spawned successfully.
Jun 26 02:49:34.588987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:49:34.636772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:34.662199 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:34.662356 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:34.783207 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:34.783431 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] Acquiring lock "b791619a-facd-4781-a2c8-84641e233b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:34.784247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:34.784673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] Lock "b791619a-facd-4781-a2c8-84641e233b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:34.784855 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] No waiting events found dispatching network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:34.785025 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-unplugged-077e020c-fd5b-49cf-9804-87f57efbd930 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:49:34.785206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Received event network-vif-deleted-077e020c-fd5b-49cf-9804-87f57efbd930 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:34.785417 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Neutron deleted interface 077e020c-fd5b-49cf-9804-87f57efbd930; detaching it from the instance and deleting it from the info cache
Jun 26 02:49:34.786944 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-215041ae-1e2a-4206-a129-fec146c50fa0 req-3fd51c54-6550-4984-8c90-cddeb1042721 service nova] [instance: b791619a-facd-4781-a2c8-84641e233b95] Detach interface failed, port_id=077e020c-fd5b-49cf-9804-87f57efbd930, reason: Instance b791619a-facd-4781-a2c8-84641e233b95 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:49:35.086937 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:35.088862 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:35.093773 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.096272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.096272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.096272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.096272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.096272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:35.169336 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:35.183894 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:35.521649 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:35.592601 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:49:35.600572 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Took 11.78 seconds to spawn the instance on the hypervisor.
Jun 26 02:49:35.600572 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:35.676580 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.625s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:35.676708 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Migrating
Jun 26 02:49:35.676911 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:49:35.691898 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: b791619a-facd-4781-a2c8-84641e233b95] Took 1.40 seconds to deallocate network for instance.
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]:     <volume>54b441cb-7c4b-4d93-9731-7cd9bdc79018</volume>
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:49:35.887135 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:49:35.894279 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:36.110213 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Took 19.20 seconds to build instance.
Jun 26 02:49:36.196768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:36.196913 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:36.197051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:36.242986 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:49:36.397022 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attempting to attach volume 54b441cb-7c4b-4d93-9731-7cd9bdc79018 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="780b0356-0bc1-4aa4-93b3-741ee46dbe82"/>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:49:36.398303 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:49:36.611352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.712s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:36.699058 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:36.748434 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:36.748583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:37.010199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:37.118413 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:37.303746 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:37.425087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:37.425326 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:37.780986 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-changed-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:37.781605 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Refreshing instance network info cache due to event network-changed-6efff377-57b3-4a30-97d4-923d2bf80ecb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:37.782293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] Acquiring lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:37.782607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] Acquired lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:37.782607 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Refreshing network info cache for port 6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:37.808452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:37.839283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:37.928100 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:38.288033 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:38.389060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:38.438819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.690s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:38.531788 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Deleted allocations for instance b791619a-facd-4781-a2c8-84641e233b95
Jun 26 02:49:38.669523 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:38.869557 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updated VIF entry in instance network info cache for port 6efff377-57b3-4a30-97d4-923d2bf80ecb. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:38.869888 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updating instance_info_cache with network_info: [{"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:39.062972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:39.066808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:39.066942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:39.067047 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:1a:81:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:49:39.334573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Starting migrate_disk_and_power_off {{(pid=98991) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}}
Jun 26 02:49:39.361462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.363715 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.377178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9206e65-6910-43c0-8a3c-122e99c900eb req-4227d2d8-4f6a-4c45-848e-e023877304e8 service nova] Releasing lock "refresh_cache-34177e20-827a-4fcf-a802-1e99eee882e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:39.395787 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.542596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.545161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-642f1ed8-5f5e-46a5-8680-78f80f8f6d21 tempest-TestInstancesWithCinderVolumes-722025130 tempest-TestInstancesWithCinderVolumes-722025130-project-member] Lock "b791619a-facd-4781-a2c8-84641e233b95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:39.548664 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:39.548829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:39.549028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:39.549126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:39.549895 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:39.549895 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-42f99be9-d45e-4596-a367-e4f37cedbdbb req-429c95a9-0760-403a-8406-761eb420aaae service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state active and task_state resize_migrating.
Jun 26 02:49:39.549895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.712023 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999745055999938 future=<Future at 0x72e29e76ed50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:39.715844 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance destroyed successfully.
Jun 26 02:49:39.717464 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:49:39.718151 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:39.719720 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:39.720724 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:49:39.721944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.722181 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape090a292-3a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:39.723797 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.725047 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:39.725799 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:39.725971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=495a4973-c967-4999-a750-49d92f6b8f53) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:39.729366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:39.732001 np0000003683 nova-compute[98991]: INFO os_vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a')
Jun 26 02:49:40.148887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:40.149051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:40.149240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "e6978931-a3e5-47b1-8d77-29481b046155-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:40.150355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:40.150541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:40.162097 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Terminating instance
Jun 26 02:49:40.280927 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Detected multiple connections on this host for volume: 30e69043-4f4b-47f3-b252-4718d5d2e28b, skipping target disconnect.
Jun 26 02:49:40.285974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:40.367589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:40.371495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:40.452579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:40.456495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:40.456495 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:40.618712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-53696a69-bf1f-42ec-9486-ddc12d317bd2 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.678s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:40.642773 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk" returned: 0 in 0.189s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:40.646492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk.config /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:40.667431 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:49:40.684444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk.config /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:40.688499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk.info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:40.706899 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:40.718348 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:40.728190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:40.745158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "cp -r /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_resize/disk.info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:40.751200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:40.758613 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:40.843494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:40.843841 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:41.003796 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999357513999712 future=<Future at 0x72e29c4ee180 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:41.005647 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Instance destroyed successfully.
Jun 26 02:49:41.006286 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lazy-loading 'resources' on Instance uuid e6978931-a3e5-47b1-8d77-29481b046155 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:41.348006 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:49:41.508740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1484249249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumeshelvetestjson-server-1484249249',id=42,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYfQJzr8ZsXiFl/EGHeKsNky0xLWQG/tyV8JJtHK7MYw0OaU8uuBbIk7xVbmqScqG/XZgEHZae++Bzuk+oUSgVtdwYusj+0+YYRFY9VieKYGtvXjSHf7bu2FCrnZeVkg==',key_name='tempest-keypair-111261166',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:49:02Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a7eadbb081143fb8f96d0187a0f7c09',ramdisk_id='',reservation_id='r-g5jqma13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-100564320',owner_user_name='tempest-AttachVolumeShelveTestJSON-100564320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:49:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7340727e31547a4b39299401535770d',uuid=e6978931-a3e5-47b1-8d77-29481b046155,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:49:41.509232 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converting VIF {"id": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "address": "fa:16:3e:41:f9:6f", "network": {"id": "86932523-edf0-4c4c-a106-c3d95aa79fe2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1372858629-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a7eadbb081143fb8f96d0187a0f7c09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap389ac5ac-04", "ovs_interfaceid": "389ac5ac-04ef-4796-b021-984e9d1f73cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:41.509511 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:41.509768 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:49:41.512321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:41.512624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap389ac5ac-04, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:41.516727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:41.520668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:41.521670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:41.521878 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f95e8107-dbd6-404b-aa2d-3ec17b45e149) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:41.523352 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:41.526276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:41.529101 np0000003683 nova-compute[98991]: INFO os_vif [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f9:6f,bridge_name='br-int',has_traffic_filtering=True,id=389ac5ac-04ef-4796-b021-984e9d1f73cd,network=Network(86932523-edf0-4c4c-a106-c3d95aa79fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389ac5ac-04')
Jun 26 02:49:41.530971 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Deleting instance files /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155_del
Jun 26 02:49:41.537113 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Deletion of /opt/stack/data/nova/instances/e6978931-a3e5-47b1-8d77-29481b046155_del complete
Jun 26 02:49:41.622667 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:41.623082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:41.623283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:41.623439 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:41.623599 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:41.623745 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-390156eb-5899-4399-8721-6cda41201c12 req-9637a228-4f85-4a60-b74b-3d5df67d8fa3 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state active and task_state resize_migrating.
Jun 26 02:49:41.900951 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:41.901394 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:41.912640 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:41.912828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:41.918373 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:49:41.918662 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Claim successful on node np0000003683
Jun 26 02:49:41.977880 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Port e090a292-3a46-4777-8978-eb75d9b4e5df binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:49:42.011774 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:42.044103 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:49:42.044719 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:49:42.044988 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:49:42.045125 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:49:42.045343 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:42.105746 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:42.433167 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Stashing vm_state: active {{(pid=98991) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 26 02:49:42.572093 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dabe8f26-750b-4f08-bea6-06f609281f0c req-2d7977b1-3e31-4d38-8f97-99bf039b4313 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Received event network-vif-deleted-389ac5ac-04ef-4796-b021-984e9d1f73cd {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:42.572787 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-dabe8f26-750b-4f08-bea6-06f609281f0c req-2d7977b1-3e31-4d38-8f97-99bf039b4313 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Neutron deleted interface 389ac5ac-04ef-4796-b021-984e9d1f73cd; detaching it from the instance and deleting it from the info cache
Jun 26 02:49:42.574442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dabe8f26-750b-4f08-bea6-06f609281f0c req-2d7977b1-3e31-4d38-8f97-99bf039b4313 service nova] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Detach interface failed, port_id=389ac5ac-04ef-4796-b021-984e9d1f73cd, reason: Instance e6978931-a3e5-47b1-8d77-29481b046155 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:49:42.994772 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:49:43.005006 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:43.013784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:43.015109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:43.015109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:43.016536 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:43.519088 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Took 1.47 seconds to deallocate network for instance.
Jun 26 02:49:43.631220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:43.631746 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:44.019911 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:44.035021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:44.134161 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:44.147097 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:44.147097 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:44.147097 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:44.455906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:44.642551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.730s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:44.643318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.638s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:44.643556 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:49:44.649986 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:45.001390 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:45.129197 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:45.157126 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:49:45.158494 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:49:45.158865 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Claim successful on node np0000003683
Jun 26 02:49:45.164434 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:49:45.164797 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:45.165031 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:45.245143 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f08f0507eec40189b858129b4cc7fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05f689c58a04254b3930f0cc279148c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:49:45.636929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:45.659134 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:49:45.674946 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating resource usage from migration 8cc56274-23cc-4a24-b521-50498a2fa972
Jun 26 02:49:45.791227 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Successfully created port: 908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:49:46.157044 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:46.162407 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:49:46.198275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:49:46.227509 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:46.287615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:49:46.287615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:49:46.299540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:49:46.301084 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738'] 
Jun 26 02:49:46.301297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:49:46.301385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:49:46.301659 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:46.409497 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Successfully updated port: 908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:49:46.415704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:46.415930 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:46.523949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:46.552455 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-changed-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:46.552455 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Refreshing instance network info cache due to event network-changed-908a9f0e-f6dd-4b04-a7d1-909a1f375d54. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:46.552455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] Acquiring lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:46.552621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] Acquired lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:46.552621 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Refreshing network info cache for port 908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:46.665891 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:46.912132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:46.922625 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:47.014198 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:47.057745 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:47.132973 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:49:47.174777 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:49:47.179756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:49:47.179756 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Creating image(s)
Jun 26 02:49:47.179756 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:47.180922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:47.180922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:47.181708 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:49:47.187544 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:49:47.189009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.301261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.301701 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:47.302118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:47.302653 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:49:47.307879 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:49:47.308263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.400490 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:47.412274 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.412904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.435196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.792s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:47.435535 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Migrating
Jun 26 02:49:47.435966 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:49:47.441629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.406s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:47.486453 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk 1073741824" returned: 0 in 0.074s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.486996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:47.487373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.544750 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Starting finish_migration {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}}
Jun 26 02:49:47.547102 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:49:47.547224 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Creating image(s)
Jun 26 02:49:47.548364 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.594531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.594975 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:49:47.595261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.648200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.648576 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:49:47.648824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:47.686909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.687384 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Cannot resize image /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:49:47.688127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:49:47.688312 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Ensure instance console log exists: /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:49:47.688921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:47.689235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:47.689468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:47.743163 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:47.743262 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Cannot resize image /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:49:47.903740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-336ee30f-0c53-4974-a607-747f332bf6ca req-6445b1c6-8c7b-446d-8b0d-1042d8162d94 service nova] Releasing lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:47.904414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquired lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:47.904774 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:47.976757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:47.976881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:47.976981 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:48.154040 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:48.154253 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:48.247987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:49:48.248136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:49:48.248408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:48.248605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:48.248723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:48.251329 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start _get_guest_xml network_info=[{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3742d0d9-f223-43ff-8205-928da9b1e65d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'f0c513bb-680e-44fa-a657-c22de6578b1b', 'attached_at': '2026-06-26T02:49:46.000000', 'detached_at': '', 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'multiattach': True, 'serial': '30e69043-4f4b-47f3-b252-4718d5d2e28b'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:49:48.253672 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:49:48.255437 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='f0c513bb-680e-44fa-a657-c22de6578b1b'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442188.2550733) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:49:48.256816 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:49:48.257152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:49:48.258261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:49:48.258440 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:49:48.259696 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:49:48.259985 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:49:48.260101 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:49:48.260185 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:49:48.260319 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:49:48.260401 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:49:48.260492 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:49:48.260649 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:49:48.260747 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:49:48.260867 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:49:48.260958 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:49:48.261065 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:49:48.272977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:48.372962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:48.374328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:48.374328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:48.374664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:48.375917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:49:48.375917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:48.376067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:48.377128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:48.377128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:49:48.391508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:48.393443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:48.394152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:48.394675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:48.394952 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:49:48.395205 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:48.414424 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:49:48.426404 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:48.432533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:48.452642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.453006 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.453413 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:48.453754 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:48.453820 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:48.456498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('9', '0', '0', 0) found on session 92 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:48.456498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:48.473132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 92 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:48.473357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.473895 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:48.474275 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:48.474564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:48.474564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:49:48.475425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('10', '0', '0', 0) found on session 93 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:49:48.475557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:49:48.479347 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:48.487931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 93 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:49:48.488192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:49:48.571110 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:49:48.657548 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:48.813826 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:48.896215 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:48.982901 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updating instance_info_cache with network_info: [{"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:49.055607 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:49.169455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.728s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:49.223765 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005075009999018221 future=<Future at 0x72e29c3a9970 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:49.223816 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:49.224061 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.487833489999957 future=<Future at 0x72e29e76ed50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:49.224061 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.487746207999862 future=<Future at 0x72e29e76ed50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:49.224809 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782442174.2230792, b791619a-facd-4781-a2c8-84641e233b95 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:49.224809 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] VM Stopped (Lifecycle Event)
Jun 26 02:49:49.230512 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Deleted allocations for instance e6978931-a3e5-47b1-8d77-29481b046155
Jun 26 02:49:49.345018 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:49.345602 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:49:49.395726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:49:49.484943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Releasing lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:49.485306 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance network_info: |[{"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:49:49.487151 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Start _get_guest_xml network_info=[{"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:49:49.490865 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:49:49.492178 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-2052843186', uuid='ed2fc500-5e0c-41d9-a529-cf132bff27be'), owner=OwnerMeta(userid='3f08f0507eec40189b858129b4cc7fd1', username='tempest-VolumesBackupsTest-1738581805-project-member', projectid='c05f689c58a04254b3930f0cc279148c', projectname='tempest-VolumesBackupsTest-1738581805'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442189.4918165) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:49:49.493218 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:49:49.493560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:49:49.494523 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:49:49.494706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:49:49.495600 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:49:49.495871 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:49:49.495999 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:49:49.496083 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:49:49.496194 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:49:49.496286 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:49:49.496366 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:49:49.496554 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:49:49.496703 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:49:49.496806 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:49:49.496904 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:49:49.497010 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:49:49.507928 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2052843186',display_name='tempest-VolumesBackupsTest-instance-2052843186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-2052843186',id=50,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQgEkkSSIz+wfs79yKdc02CqAztM2kfsGGO2GWOhG6v7AHEf5sNxW/rYcaiZt3Nb488QWnRokYEBYx+zpVNx1zXoLvngalRuMsKNGt/oUS49CZspXKRcY3o3rNpz0E59g==',key_name='tempest-keypair-70909028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-0k0isqpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=ed2fc500-5e0c-41d9-a529-cf132bff27be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:49:49.508098 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:49.508751 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:49.509502 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'pci_devices' on Instance uuid ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:49.557512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:49.727303 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: b791619a-facd-4781-a2c8-84641e233b95] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <uuid>ed2fc500-5e0c-41d9-a529-cf132bff27be</uuid>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <name>instance-00000032</name>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesBackupsTest-instance-2052843186</nova:name>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:49:49</nova:creationTime>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:user uuid="3f08f0507eec40189b858129b4cc7fd1">tempest-VolumesBackupsTest-1738581805-project-member</nova:user>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:project uuid="c05f689c58a04254b3930f0cc279148c">tempest-VolumesBackupsTest-1738581805</nova:project>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         <nova:port uuid="908a9f0e-f6dd-4b04-a7d1-909a1f375d54">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="serial">ed2fc500-5e0c-41d9-a529-cf132bff27be</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="uuid">ed2fc500-5e0c-41d9-a529-cf132bff27be</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.config"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b5:b1:0f"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <target dev="tap908a9f0e-f6"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/console.log" append="off"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:49:50.012094 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Preparing to wait for external event network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2052843186',display_name='tempest-VolumesBackupsTest-instance-2052843186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-2052843186',id=50,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQgEkkSSIz+wfs79yKdc02CqAztM2kfsGGO2GWOhG6v7AHEf5sNxW/rYcaiZt3Nb488QWnRokYEBYx+zpVNx1zXoLvngalRuMsKNGt/oUS49CZspXKRcY3o3rNpz0E59g==',key_name='tempest-keypair-70909028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-0k0isqpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=ed2fc500-5e0c-41d9-a529-cf132bff27be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:50.014121 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:49:50.014421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.015693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.015693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:49:50.015693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.015693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63efc683-e52a-5e84-9b15-96129d9c29e1', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.031036 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.031949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:50.033791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.035547 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.035669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908a9f0e-f6, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.035953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap908a9f0e-f6, col_values=(('qos', UUID('6371eb50-d0d4-47da-8d18-074eab2d9aa9')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.036105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap908a9f0e-f6, col_values=(('external_ids', {'iface-id': '908a9f0e-f6dd-4b04-a7d1-909a1f375d54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b1:0f', 'vm-uuid': 'ed2fc500-5e0c-41d9-a529-cf132bff27be'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.036906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.038337 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:50.045032 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.045694 np0000003683 nova-compute[98991]: INFO os_vif [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6')
Jun 26 02:49:50.240994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcb6b131-c559-47f6-a806-801a859acdb0 tempest-AttachVolumeShelveTestJSON-100564320 tempest-AttachVolumeShelveTestJSON-100564320-project-member] Lock "e6978931-a3e5-47b1-8d77-29481b046155" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.092s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:50.343979 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:50.410901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 3300000007341c2f6 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:49:50.411197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:50.411274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:50.411390 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007341c2f6', 'path': '/dev/dm-1', 'multipath_id': '3300000007341c2f6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:49:50.849183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:50.849408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:50.849620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:50.849746 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:49:50.917505 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:49:50.917812 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:50.918153 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <uuid>f0c513bb-680e-44fa-a657-c22de6578b1b</uuid>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <name>instance-0000002d</name>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <memory>262144</memory>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:name>multiattach-server-1</nova:name>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:49:48</nova:creationTime>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.micro" id="84">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:memory>256</nova:memory>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         <nova:port uuid="e090a292-3a46-4777-8978-eb75d9b4e5df">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="serial">f0c513bb-680e-44fa-a657-c22de6578b1b</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="uuid">f0c513bb-680e-44fa-a657-c22de6578b1b</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk.config"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <shareable/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:18:02:69"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <target dev="tape090a292-3a"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/console.log" append="off"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:49:50.919327 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "vif_mac": "fa:16:3e:18:02:69"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.921992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:49:50.923012 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.923296 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '463fd289-bd7d-5ff4-ac10-6b7a5a7d9550', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.924566 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.925372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:50.931775 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.934743 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.934998 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape090a292-3a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.935366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape090a292-3a, col_values=(('qos', UUID('217812c3-4c7a-4717-9124-833acf26babc')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.935553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape090a292-3a, col_values=(('external_ids', {'iface-id': 'e090a292-3a46-4777-8978-eb75d9b4e5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:02:69', 'vm-uuid': 'f0c513bb-680e-44fa-a657-c22de6578b1b'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:50.939503 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:50.947643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:50.948642 np0000003683 nova-compute[98991]: INFO os_vif [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a')
Jun 26 02:49:51.072306 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Starting migrate_disk_and_power_off {{(pid=98991) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}}
Jun 26 02:49:51.128306 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.158320 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.195410 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.321026 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:51.321615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:51.321809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:51.322001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:51.322184 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:51.322364 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-73367a7a-5628-4de2-a4ee-5cd69ea792d5 req-b5ae1bc2-eea0-4148-a2f4-c1fadce9b34c service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state active and task_state resize_migrating.
Jun 26 02:49:51.410936 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999623358000008 future=<Future at 0x72e29c4edc70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:51.412835 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance destroyed successfully.
Jun 26 02:49:51.414093 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:49:51.414411 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:49:51.415194 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:49:51.415551 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:49:51.417044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.417254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cc1c496-63, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:51.419856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.420818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:51.432441 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.433655 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.434233 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df9ce035-98e0-4b8e-91f1-4dfdb620e59a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:49:51.437019 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:49:51.447113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:51.449129 np0000003683 nova-compute[98991]: INFO os_vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:49:51.453025 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:49:51.453333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:51.453543 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:49:51.565923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:51.565923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:51.565923 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No VIF found with MAC fa:16:3e:b5:b1:0f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:49:51.565923 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Using config drive
Jun 26 02:49:51.887043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:51.888542 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:51.889911 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:51.892983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:51.982258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:51.982728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.018364 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:52.075127 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:52.079881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.080354 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:52.089596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.185407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.185932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.260538 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Creating config drive at /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.config
Jun 26 02:49:52.265023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0r84wann {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.291676 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.292496 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:52.300030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.330827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0r84wann" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.396381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.396908 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.472101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:52.472101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:52.472282 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:49:52.472346 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:18:02:69, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:49:52.472994 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Using config drive
Jun 26 02:49:52.489508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.489944 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-11 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:52.492136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.592783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.593473 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:52.678596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:52.869580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:52.894881 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.037725 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ad10398c-1b05-4499-87a6-81b2e7541ffb req-09bcb3c4-b313-480a-a8f8-ce9bdc408cdf service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:53.038966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ad10398c-1b05-4499-87a6-81b2e7541ffb req-09bcb3c4-b313-480a-a8f8-ce9bdc408cdf service nova] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:53.039194 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ad10398c-1b05-4499-87a6-81b2e7541ffb req-09bcb3c4-b313-480a-a8f8-ce9bdc408cdf service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:53.039266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ad10398c-1b05-4499-87a6-81b2e7541ffb req-09bcb3c4-b313-480a-a8f8-ce9bdc408cdf service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:53.039376 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ad10398c-1b05-4499-87a6-81b2e7541ffb req-09bcb3c4-b313-480a-a8f8-ce9bdc408cdf service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Processing event network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:49:53.058060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.216212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.230045 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.233668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.259713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.267308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.301643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.320699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.867s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:49:53.323714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:49:53.323714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:49:53.332057 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.337321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:53.360041 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:49:53.360270 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:49:53.360743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:49:53.360743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '109')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:53.362452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '108')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:49:53.364195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e788400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:49:53.364822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdj, sdm {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:49:53.365324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 330000000844c6185 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:49:53.391855 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:53.392500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:53.392761 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:53.392951 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:53.393167 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:53.393358 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-babd616f-088c-4163-90b3-6517d9d3da13 req-0e79ec13-b8ac-4fea-82ef-1b2c065b89bd service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state active and task_state resize_migrating.
Jun 26 02:49:53.398593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:53.434534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.435110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.454518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:49:53.515217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdj, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:49:53.515466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdj, sdm have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:49:53.519376 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdj', 'sdm'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:49:53.534969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdj', 'sdm'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:49:53.535406 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:49:53.543751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.546647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:53.549675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.558090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.558636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.590872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:49:53.590872 np0000003683 nova-compute[98991]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:49:53.590872 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.613890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.629443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.669201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.672564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:49:53.672564 np0000003683 nova-compute[98991]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:49:53.672564 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.674133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.696596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:49:53.698388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:49:53.698869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (2244ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:53.699243 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:49:53.707567 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.773181 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.776339 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.836292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.836966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.887099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.891936 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:49:53.893385 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:53.941593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.942111 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=49040MB free_disk=73.19524765014648GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:49:53.942544 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:53.942679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:53.944576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:53.946545 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-11 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:49:53.946545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:54.045323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:54.046035 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk.config /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:54.086754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk.config /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config" returned: 0 in 0.041s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:54.087193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk.info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:54.106202 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442194.1044323, ed2fc500-5e0c-41d9-a529-cf132bff27be => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:54.107564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:49:54.107959 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] VM Started (Lifecycle Event)
Jun 26 02:49:54.112910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:49:54.116223 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance spawned successfully.
Jun 26 02:49:54.116853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:49:54.130027 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "cp -r /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_resize/disk.info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" returned: 0 in 0.043s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:49:54.173843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:49:54.178934 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance running successfully.
Jun 26 02:49:54.180267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Failed to set time: agent not configured {{(pid=98991) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 26 02:49:54.180411 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-43b28acd-1c7a-42dc-a7a7-609c4b374625 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] finish_migration finished successfully. {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}}
Jun 26 02:49:54.617359 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:54.624451 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:54.627290 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.627290 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.627644 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.627915 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.628225 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.629536 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:49:54.716027 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.004171832999873004 future=<Future at 0x72e29e76ed50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:54.717116 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Emitting event <LifecycleEvent: 1782442179.711688, f0c513bb-680e-44fa-a657-c22de6578b1b => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:54.717324 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:54.717573 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Stopped (Lifecycle Event)
Jun 26 02:49:54.719908 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.2829473880001387 future=<Future at 0x72e29c4ee180 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:54.720063 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.2827681949997896 future=<Future at 0x72e29c4ee180 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:54.983291 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Applying migration context for instance 126a33da-d066-4fbf-bb4c-5da1f41252ed as it has an incoming, in-progress migration 8cc56274-23cc-4a24-b521-50498a2fa972. Migration status is migrating {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 26 02:49:54.983546 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Applying migration context for instance f0c513bb-680e-44fa-a657-c22de6578b1b as it has an incoming, in-progress migration d42c3101-4d72-453e-b4b3-f08e4bbc352e. Migration status is finished {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 26 02:49:54.985370 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating resource usage from migration 8cc56274-23cc-4a24-b521-50498a2fa972
Jun 26 02:49:54.985788 np0000003683 nova-compute[98991]: INFO nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating resource usage from migration d42c3101-4d72-453e-b4b3-f08e4bbc352e
Jun 26 02:49:55.053857 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054043 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054222 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 438d9a42-bd81-4489-8c87-68f146dfc61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054374 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ecba11d0-cb36-45bd-afce-8a4a2666c369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054536 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054684 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 34177e20-827a-4fcf-a802-1e99eee882e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.054801 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Migration d42c3101-4d72-453e-b4b3-f08e4bbc352e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 26 02:49:55.055164 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance f0c513bb-680e-44fa-a657-c22de6578b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.055393 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ed2fc500-5e0c-41d9-a529-cf132bff27be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.055511 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Migration 8cc56274-23cc-4a24-b521-50498a2fa972 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 26 02:49:55.055624 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 126a33da-d066-4fbf-bb4c-5da1f41252ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:49:55.055806 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 11 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:49:55.055923 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=2752MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:49:53 up 36 min,  2 users,  load average: 9.66, 7.67, 4.50\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_f2b74afe940c40d490cd930d9056fc92': '5', 'io_workload': '2', 'num_task_resize_finish': '1', 'num_proj_addc661d189b4a8c8e130200e4d2c30a': '2', 'num_task_resize_migrating': '1', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_c05f689c58a04254b3930f0cc279148c': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:49:55.120622 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:55.121289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:55.121556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:55.121754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:55.121820 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] No waiting events found dispatching network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:55.121935 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received unexpected event network-vif-plugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 for instance with vm_state building and task_state spawning.
Jun 26 02:49:55.122062 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:55.122228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:55.122369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:55.122452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:55.122580 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:55.122715 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state resized and task_state None.
Jun 26 02:49:55.122823 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:55.122971 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:55.123099 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:55.123189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:55.123306 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:49:55.123393 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-94981f79-0892-4df5-9b0d-c0fd4d2d30dc req-04ecc911-7c4e-4ef4-afe2-ca85a763d25a service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received unexpected event network-vif-plugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with vm_state resized and task_state None.
Jun 26 02:49:55.133813 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:49:55.135361 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Took 7.96 seconds to spawn the instance on the hypervisor.
Jun 26 02:49:55.135953 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442195.1354494, ed2fc500-5e0c-41d9-a529-cf132bff27be => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:55.136224 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:55.136434 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] VM Paused (Lifecycle Event)
Jun 26 02:49:55.171788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:55.223539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-547bae26-25c4-44b7-a4fa-2ccd1bce2bbc tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:55.276822 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:55.277046 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:55.365939 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:49:55.632991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:49:55.633426 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:49:55.644577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:55.649893 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Took 13.80 seconds to build instance.
Jun 26 02:49:55.650986 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442195.6507974, ed2fc500-5e0c-41d9-a529-cf132bff27be => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:55.651135 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] VM Resumed (Lifecycle Event)
Jun 26 02:49:56.003668 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0007739130001027661 future=<Future at 0x72e29c4ee180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:56.004222 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] Emitting event <LifecycleEvent: 1782442181.002662, e6978931-a3e5-47b1-8d77-29481b046155 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:56.004548 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:56.004719 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] VM Stopped (Lifecycle Event)
Jun 26 02:49:56.005718 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.40480443000024 future=<Future at 0x72e29c4edc70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:56.005883 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.404635456000051 future=<Future at 0x72e29c4edc70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:49:56.137456 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:49:56.155498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.309s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:56.155498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:56.163628 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:56.386684 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:49:56.396929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:56.396929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:56.396929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:56.435734 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:56.508403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-67f80d97-3eac-44a4-b9c0-a3dde597fe3a tempest-AttachVolumeTestJSON-391502958 tempest-AttachVolumeTestJSON-391502958-project-member] [instance: e6978931-a3e5-47b1-8d77-29481b046155] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:56.604301 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:56.605793 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:49:56.605793 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Going to confirm migration 4 {{(pid=98991) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 26 02:49:56.649036 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:49:56.649860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.707s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:49:56.650265 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:49:56.665816 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442196.6654592, f0c513bb-680e-44fa-a657-c22de6578b1b => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:56.665969 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Resumed (Lifecycle Event)
Jun 26 02:49:56.926094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-changed-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:49:56.926610 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Refreshing instance network info cache due to event network-changed-908a9f0e-f6dd-4b04-a7d1-909a1f375d54. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:49:56.926843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] Acquiring lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:56.926992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] Acquired lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:56.927192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Refreshing network info cache for port 908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:49:57.019412 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:49:57.118763 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:57.168198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:57.173340 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:57.287024 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:57.287328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:57.287458 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:57.287609 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:57.287765 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'info_cache' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:57.422548 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:57.430549 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:57.502976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:49:57.503143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:49:57.503302 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:49:57.678853 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442197.6785305, f0c513bb-680e-44fa-a657-c22de6578b1b => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:49:57.679199 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Started (Lifecycle Event)
Jun 26 02:49:57.829269 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:58.005570 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:58.016656 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updated VIF entry in instance network info cache for port 908a9f0e-f6dd-4b04-a7d1-909a1f375d54. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:49:58.017018 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updating instance_info_cache with network_info: [{"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:58.181946 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:49:58.184704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:49:58.292779 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:58.382016 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:58.520647 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-45b57396-0d2d-4348-a98f-cc571eff7465 req-0fd02578-b84e-4dcb-91a3-34a1c6e76f7a service nova] Releasing lock "refresh_cache-ed2fc500-5e0c-41d9-a529-cf132bff27be" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:58.573512 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:58.618238 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:49:58.769347 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:49:59.073613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:59.271413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:49:59.271624 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'migration_context' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:49:59.582015 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:49:59.594517 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:49:59.615620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:49:59.647622 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.648316 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.648553 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.648887 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.649116 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.649493 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.649727 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:49:59.650045 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:49:59.650432 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.69 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:49:59.665992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:49:59.666285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:49:59.676109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:49:59.677788 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:49:59.677947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:49:59.678041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:49:59.678416 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:49:59.774346 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Object Instance<f0c513bb-680e-44fa-a657-c22de6578b1b> lazy-loaded attributes: info_cache,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:49:59.780224 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:49:59.780509 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:00.843597 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Starting finish_migration {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}}
Jun 26 02:50:00.845517 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance directory exists: not creating {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 26 02:50:00.845898 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Creating image(s)
Jun 26 02:50:00.847033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:00.875867 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:00.876342 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:00.941192 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:00.941688 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:50:00.941959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:01.047269 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:01.047669 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Cannot resize image /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:50:01.382664 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:01.436800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:01.550838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:50:01.551149 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Ensure instance console log exists: /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:01.551662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:01.551997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:01.552185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:01.556344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start _get_guest_xml network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b53006ea-64e7-413e-a88d-0d907447f94b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '2026-06-26T02:50:00.000000', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:01.562393 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:01.564413 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-388591585', uuid='126a33da-d066-4fbf-bb4c-5da1f41252ed'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1423927717', flavorid='2cd611f3-9bb9-45d7-b328-6e599b4e592d', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442201.563831) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:01.566248 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:01.566975 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:01.568771 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:01.569275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:01.571053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:01.571578 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:49:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='2cd611f3-9bb9-45d7-b328-6e599b4e592d',id=13,is_public=True,memory_mb=192,name='tempest-1423927717',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:01.571807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:01.571976 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:01.572245 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:01.572400 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:01.572710 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:01.573117 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:01.573890 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:01.574058 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:01.574531 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:01.574721 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:01.588437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:01.681019 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:01.684014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:01.684279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:01.684826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:01.685387 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:01.685805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:01.685955 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:01.686323 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:01.686782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:01.699499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:01.699499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:01.699721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:01.699846 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:01.700245 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:01.700430 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:01.711898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:01.711898 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:01.725508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:01.725508 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:01.732841 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:01.738409 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:02.020858 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:02.400200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.620s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:02.733252 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:02.740091 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:02.755309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:02.766605 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.769366 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.783853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.793408 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.793766 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.806892 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.807225 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:02.842172 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:50:02.842172 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:02.842172 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.864530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.885740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:50:02.885740 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:02.885740 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.891079 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.891495 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:02.891803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:02.891803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:02.895172 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('8', '-', '-', 0) found on session 114 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:02.895310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:02.900084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:02.917092 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 114 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:02.917286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.924004 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:02.924571 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:02.925502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:02.925502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:02.926363 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('16', '-', '-', 0) found on session 115 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:02.926491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:02.943967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 115 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:02.944050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:03.086994 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocation for migration d42c3101-4d72-453e-b4b3-f08e4bbc352e
Jun 26 02:50:03.594843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f0fa6991-72c2-4de8-a536-7abc7b154074 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.990s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:03.702710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:50:04.204022 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:04.204416 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing instance network info cache due to event network-changed-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:04.204416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] Acquiring lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:04.204416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] Acquired lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:04.204588 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Refreshing network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:04.707717 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:04.719224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 330000000844c6185 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:04.719627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:04.720654 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000844c6185'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:04.720837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000844c6185'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:04.777490 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '2026-06-26T02:50:00.000000', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:50:04.778052 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:50:04.778261 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:50:04.778413 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]:     <volume>54b441cb-7c4b-4d93-9731-7cd9bdc79018</volume>
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:50:04.795866 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:50:05.070778 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:05.218509 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updated VIF entry in instance network info cache for port c7cfe23d-16e2-4912-8b79-2d44cb60e8c5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:50:05.218898 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [{"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:05.309175 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:05.309403 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:05.310029 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <uuid>126a33da-d066-4fbf-bb4c-5da1f41252ed</uuid>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <name>instance-00000030</name>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-388591585</nova:name>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:01</nova:creationTime>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:flavor name="tempest-1423927717" id="2cd611f3-9bb9-45d7-b328-6e599b4e592d">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:extraSpecs/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <nova:port uuid="0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="serial">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="uuid">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <encryption format="luks">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:         <secret type="passphrase" uuid="af29dbc6-3135-417b-b07a-d3abb0fe9b8a"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       </encryption>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1a:81:38"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <target dev="tap0cc1c496-63"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/console.log" append="off"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:05.312057 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:05.314469 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:05.314469 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "vif_mac": "fa:16:3e:1a:81:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:05.314469 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:05.314469 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:05.314469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.314786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:05.315419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:05.317758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.317758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26e2f714-6539-5e6d-bd98-49d058a1424b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:05.317758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.317758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:05.320074 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.321567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.321752 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cc1c496-63, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:05.322125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cc1c496-63, col_values=(('qos', UUID('68ef13e8-c8e0-4b27-a3b5-55ae30770b86')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:05.322302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cc1c496-63, col_values=(('external_ids', {'iface-id': '0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:81:38', 'vm-uuid': '126a33da-d066-4fbf-bb4c-5da1f41252ed'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:05.324367 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.325571 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:05.332299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:05.333526 np0000003683 nova-compute[98991]: INFO os_vif [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:50:05.721402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f40680b8-5414-4dd8-9ed3-90d939783d56 req-3f73ae71-c056-4cd8-88ae-6f66bd762b86 service nova] Releasing lock "refresh_cache-2f7efbb6-021e-4bc3-a514-f21f96d3ff29" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:06.304950 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:06.305370 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing instance network info cache due to event network-changed-e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:06.305370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] Acquiring lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:06.305511 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] Acquired lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:06.305650 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Refreshing network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:06.410996 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00042988599989257636 future=<Future at 0x72e29c4edc70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:06.411136 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:06.411817 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Emitting event <LifecycleEvent: 1782442191.4104502, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:06.412255 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Stopped (Lifecycle Event)
Jun 26 02:50:06.808701 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:06.855931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:06.856817 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:06.856817 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:06.856817 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] No VIF found with MAC fa:16:3e:1a:81:38, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:06.857252 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Using config drive
Jun 26 02:50:06.915189 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:07.022596 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.234564 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:07.349976 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.387869 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.487772 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updated VIF entry in instance network info cache for port e090a292-3a46-4777-8978-eb75d9b4e5df. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:50:07.487772 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [{"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:07.507971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.665559 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:07.665559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:07.665559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:07.665559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:07.665559 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:07.668206 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1d37efae-760d-403c-a003-1d4920999f5b req-a538fb9a-6dda-4f61-b49e-80bea30230f4 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state active and task_state resize_finish.
Jun 26 02:50:07.726208 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:50:07.784661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.787698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.796451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.829236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:07.992906 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e960e79-d860-4db8-a167-27ba9fac9ec9 req-681d560e-d3de-40ec-bea7-19a78f660f94 service nova] Releasing lock "refresh_cache-f0c513bb-680e-44fa-a657-c22de6578b1b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:09.503773 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442209.5034032, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:09.504172 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Resumed (Lifecycle Event)
Jun 26 02:50:09.507921 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:09.512178 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance running successfully.
Jun 26 02:50:09.515467 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Failed to set time: agent not configured {{(pid=98991) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 26 02:50:09.515588 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8661305a-560a-400a-84c5-5f8ce1e22d97 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] finish_migration finished successfully. {{(pid=98991) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}}
Jun 26 02:50:09.901618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:09.903421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:09.903421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:09.903421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:09.903421 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:09.903421 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c63b369f-8168-4354-8dc2-7b52b0a5f061 req-bfa7ed82-03ce-4610-855d-c7da10ab8aed service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state active and task_state resize_finish.
Jun 26 02:50:10.006173 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:10.009809 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:10.324038 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:10.512430 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 26 02:50:10.514169 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442210.5138967, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:10.514362 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Started (Lifecycle Event)
Jun 26 02:50:11.016786 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:11.019140 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:11.440529 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:11.521565 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 26 02:50:11.544230 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:11.544673 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:11.545019 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:11.616133 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Port 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b binding to destination host np0000003683 is already ACTIVE {{(pid=98991) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
Jun 26 02:50:11.616423 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:11.616781 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:11.616910 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:12.031681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:12.120044 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:12.512334 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:12.640196 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:13.144936 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:13.650368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Creating tmpfile /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/tmp1_nxutee to verify with other compute node that the instance is on the same shared storage. {{(pid=98991) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10568}}
Jun 26 02:50:13.650709 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:50:14.170983 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.173618 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.192077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.202409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.230415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.235319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.333743 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:14.334131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:14.334287 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:14.334443 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:14.334603 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:14.334719 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3412c720-60e9-40bf-b03a-14ebeba9794a req-b2f08c9c-b5be-42a4-a11a-0de2bbcb7f89 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state resized and task_state resize_reverting.
Jun 26 02:50:14.451380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.458855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.487200 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999696586000027 future=<Future at 0x72e27c27c4d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:14.487720 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999107919999915 future=<Future at 0x72e27c27c4d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:14.487915 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99889577499971 future=<Future at 0x72e27c27c4d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:14.489709 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance destroyed successfully.
Jun 26 02:50:14.490259 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'resources' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:14.992618 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:10Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:50:14.993286 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:14.993286 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:14.993512 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:50:14.994499 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.994748 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cc1c496-63, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:14.995741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.996524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:14.996971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.997414 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.997619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68ef13e8-c8e0-4b27-a3b5-55ae30770b86) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:14.998008 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:14.998498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:14.998826 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:15.000377 np0000003683 nova-compute[98991]: INFO os_vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:50:15.003192 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:50:15.003981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:15.003981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:15.146747 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:15.146863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:15.455598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.452s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:15.456030 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:50:15.456197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:15.487610 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:15.487848 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:15.488053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:50:15.488053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '115')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:50:15.488948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '114')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:50:15.489875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7b76a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:50:15.490103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdc, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:50:15.490325 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 330000000844c6185 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:50:15.525822 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:50:15.578373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:50:15.637095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdc, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:50:15.637212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdc, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:50:15.638611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdc', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:50:15.650944 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:50:15.652354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdc', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:50:15.652594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:50:15.665428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.703186 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:50:15.703186 np0000003683 nova-compute[98991]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:15.703186 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.722695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.733413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.766599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:50:15.766599 np0000003683 nova-compute[98991]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:15.766599 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.784691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:15.785666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:15.785818 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (782ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:15.785910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:50:16.197465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:16.197911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:16.201225 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:50:16.201368 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Claim successful on node np0000003683
Jun 26 02:50:16.454876 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:16.455708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:16.455708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:16.455708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:16.456028 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:16.456204 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-dd55a874-0906-41c0-babe-4ef0ba2b76a5 req-49c6fa8c-f817-4291-baf1-fa5c3927d770 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state resized and task_state resize_reverting.
Jun 26 02:50:16.992303 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:17.033307 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:17.713062 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:17.713430 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:18.216251 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:18.726910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:18.727848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 1.735s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:18.728959 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:50:19.234655 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'migration_context' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:19.239250 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:50:19.239540 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:50:19.240045 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:19.240404 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:19.341777 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6abcc90720de4d3e8d49aa5c4bb02b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a7fdd73fc40328c4c73ef53edc697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:50:19.746815 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:50:19.751847 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Object Instance<126a33da-d066-4fbf-bb4c-5da1f41252ed> lazy-loaded attributes: resources,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:50:19.971592 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Successfully created port: c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:50:19.999730 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:20.384315 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:20.384930 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:20.590434 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Successfully updated port: c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:50:20.647089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-changed-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:20.647089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Refreshing instance network info cache due to event network-changed-c2f40694-6df1-42ed-87e8-dbf564e1b93e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:20.647089 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] Acquiring lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:20.647089 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] Acquired lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:20.647089 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Refreshing network info cache for port c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:20.741286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:20.741286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:20.754852 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:50:20.888335 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:21.092667 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:21.149530 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:21.238760 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:50:21.250948 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:21.264979 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Booting with volume a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 at /dev/vdb
Jun 26 02:50:21.336816 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:21.350958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:50:21.377558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:21.409373 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:21.443650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:50:21.444667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:50:21.457804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:50:21.460650 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:50:21.460650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:50:21.460650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:50:21.460650 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:21.461181 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updating existing volume attachment record: 872d2986-4bfb-49c8-bb80-9e1637574202 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:50:21.805413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:21.918777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.191s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:21.919016 np0000003683 nova-compute[98991]: DEBUG nova.compute.rpcapi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98991) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 26 02:50:21.925611 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.120s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:21.927139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d43f2bb-691c-4304-b303-1e86d7068afe req-9e5a6ecb-c4ad-4c67-b4c9-61974d5741d9 service nova] Releasing lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:21.929337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquired lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:21.930259 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:21.948420 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:50:21.949448 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Claim successful on node np0000003683
Jun 26 02:50:22.035309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:22.513635 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:22.699277 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:22.835179 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updating instance_info_cache with network_info: [{"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:23.337156 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Releasing lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:23.337548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance network_info: |[{"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:50:23.530426 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Swapping old allocation on dict_keys(['af1bc8b6-4321-4361-b703-e0f6b10a10af']) held by migration 8cc56274-23cc-4a24-b521-50498a2fa972 for instance
Jun 26 02:50:23.584140 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:50:23.589901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:50:23.590230 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Creating image(s)
Jun 26 02:50:23.590871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:23.591079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:23.591637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:23.594139 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:23.597605 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:23.598136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:23.599631 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:23.600390 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:23.647194 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Overwriting current allocation {'allocations': {'af1bc8b6-4321-4361-b703-e0f6b10a10af': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 70}}, 'project_id': '419e029cdd744c1598f7a9d2bcc52340', 'user_id': '13af0bfb96bf40179144f66af7baeed9', 'consumer_generation': 1} on consumer 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
Jun 26 02:50:23.695525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:23.695929 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:23.696361 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:23.697020 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:23.699658 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:23.699965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:23.738252 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:23.796177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:23.796177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:23.814770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:23.814952 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquired lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:23.815176 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:23.856802 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk 1073741824" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:23.857972 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:23.858285 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:23.967276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:23.967781 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:50:23.968106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:24.082473 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:24.082969 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Cannot resize image /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:50:24.083652 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:50:24.083843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Ensure instance console log exists: /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:24.084444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:24.084714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:24.084934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:24.087321 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Start _get_guest_xml network_info=[{"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '872d2986-4bfb-49c8-bb80-9e1637574202', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '173e3dc3-be91-41bc-b353-ecac928a7c90', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'serial': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': -1, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:24.092457 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:24.094150 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-instance-82425095', uuid='173e3dc3-be91-41bc-b353-ecac928a7c90'), owner=OwnerMeta(userid='6abcc90720de4d3e8d49aa5c4bb02b11', username='tempest-VolumesBackupsTest-232973889-project-member', projectid='7a0a7fdd73fc40328c4c73ef53edc697', projectname='tempest-VolumesBackupsTest-232973889'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442224.0937152) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:24.095363 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:24.095807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:24.097222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:24.097555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:24.099288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:24.099716 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:24.099886 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:24.100054 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:24.100271 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:24.100399 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:24.100763 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:24.100982 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:24.101148 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:24.101326 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:24.101458 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:24.102864 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:24.111078 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:24.124275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:24.124772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:24.124978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:24.125360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:24.125598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:24.137670 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:24.138265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:24.138744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:24.139121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:24.139380 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:24.139629 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:24.152559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:24.152559 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:24.152985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:24.152985 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0] added
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:24.166902 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:24.167069 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:24.167222 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:24.167363 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0] added
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:24.176375 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:24.176553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:24.176674 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:24.176791 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:24.321535 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:24.565967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:24.566159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:24.621967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.696s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:24.622280 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:50:24.649653 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:24.804501 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:25.009879 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:25.068846 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Detaching volume 30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:50:25.133098 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:50:25.135508 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:50:25.137518 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Attempting to driver detach volume 30e69043-4f4b-47f3-b252-4718d5d2e28b from mountpoint /dev/vdb
Jun 26 02:50:25.137518 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:25.137794 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:25.142975 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:25.144288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:25.144288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Attempting to detach device vdb from instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:25.144554 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:25.150800 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 from the persistent domain config.
Jun 26 02:50:25.150800 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] (1/8): Attempting to detach device vdb with device alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b from instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:25.151019 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:25.167769 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:25.178895 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:25.186348 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.198571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:25.209128 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.220813 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.221072 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:25.225108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.237662 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dabf44f7bd7d4f0bb60de94c0db9de53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addc661d189b4a8c8e130200e4d2c30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.250949 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:25.280014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260]
Jun 26 02:50:25.280014 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:25.280014 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.302166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.303838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Releasing lock "refresh_cache-126a33da-d066-4fbf-bb4c-5da1f41252ed" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:25.304593 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:25.316920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.50.100,3260]
Jun 26 02:50:25.316920 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:25.316920 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:25.323391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:25.327808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] HCTL ('8', '-', '-', 0) found on session 117 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:25.327808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:25.334465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:50:25.340292 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:25.354185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Searching for a device in session 117 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:25.354395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.362708 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:25.363418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:25.365360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] HCTL ('15', '-', '-', 0) found on session 118 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:25.365779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:25.365941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:25.386410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Searching for a device in session 118 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:25.386410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:25.410768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:50:25.410850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:50:25.421610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:50:25.422874 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:50:25.422988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:50:25.423065 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:50:25.423295 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:25.642508 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:50:25.726664 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442225.7261786, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => ua-30e69043-4f4b-47f3-b252-4718d5d2e28b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:50:25.727118 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b for instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:50:25.730191 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 from the live domain config.
Jun 26 02:50:25.751464 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Successfully created port: 466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:50:26.140847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:50:26.144985 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:50:26.270243 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Detected multiple connections on this host for volume: 30e69043-4f4b-47f3-b252-4718d5d2e28b, skipping target disconnect.
Jun 26 02:50:26.295300 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Successfully updated port: 466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:50:26.465376 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-changed-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:26.465774 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Refreshing instance network info cache due to event network-changed-466b9e64-ee02-48ce-8d31-3c994089d383. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:26.466082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] Acquiring lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:26.466126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] Acquired lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:26.466260 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Refreshing network info cache for port 466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:26.522583 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Starting finish_revert_migration {{(pid=98991) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12953}}
Jun 26 02:50:26.535330 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start _get_guest_xml network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3e2d1400-f2dc-43a7-9a85-226a579d9ade', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '2026-06-26T02:50:26.000000', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:26.537130 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:26.538279 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-388591585', uuid='126a33da-d066-4fbf-bb4c-5da1f41252ed'), owner=OwnerMeta(userid='13af0bfb96bf40179144f66af7baeed9', username='tempest-TestEncryptedCinderVolumes-1629371133-project-member', projectid='419e029cdd744c1598f7a9d2bcc52340', projectname='tempest-TestEncryptedCinderVolumes-1629371133'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442226.5378962) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:26.539957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:26.540251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:26.541010 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:26.541148 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:26.541979 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:26.542231 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:26.542344 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:26.542430 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:26.542652 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:26.542738 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:26.542831 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:26.542968 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:26.543054 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:26.543149 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:26.543315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:26.543467 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:26.543783 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'vcpu_model' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:26.649852 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Booting with volume 5013b4c0-b1f8-4e71-af85-cf8a7047cd85 at /dev/vda
Jun 26 02:50:26.696637 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:26.706832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:50:26.724111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:26.777223 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:50:26.777581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:50:26.788500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:50:26.790191 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269'] 
Jun 26 02:50:26.790191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:50:26.790191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:50:26.790191 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:26.791651 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updating existing volume attachment record: 6ff1965e-35ec-4d42-8e7c-f18696a64da9 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:50:26.798596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:26.821177 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:26.968146 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:27.038878 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:27.041038 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:27.058557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:27.152907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:27.153451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:27.153560 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:27.154151 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:27.154535 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:27.154864 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:27.155002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:27.159843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Found WWN 330000000c7f4e315 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:27.160470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:27.160777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000c7f4e315', 'path': '/dev/dm-0', 'multipath_id': '330000000c7f4e315'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:27.161366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c7f4e315', 'path': '/dev/dm-0', 'multipath_id': '330000000c7f4e315'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:27.161596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:27.162018 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:27.175658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:27.176420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:27.177077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:27.177423 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:27.178861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:27.179221 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:27.190396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:27.190396 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:27.197447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:27.197447 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:27.203241 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:27.205198 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:27.205441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:27.205712 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:27.205800 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018] added
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:27.209427 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:27.209787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:27.209787 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:27.209886 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:27.671488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-82425095',display_name='tempest-instance-82425095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-instance-82425095',id=51,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJJL90802W01rdKiBGumzKL49Bluvhm37UOGv5Q5xLi/mqbwWB18no25wTut6XBbW1xQCH2iw53Cbk6p9oX6a17n4v9GXO5oRhl3MHUTr+cUXt7ja/1u7GXMy0bDlgWDQ==',key_name='tempest-keypair-179190207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0a7fdd73fc40328c4c73ef53edc697',ramdisk_id='',reservation_id='r-mofewi97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-232973889',owner_user_name='tempest-VolumesBackupsTest-232973889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abcc90720de4d3e8d49aa5c4bb02b11',uuid=173e3dc3-be91-41bc-b353-ecac928a7c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:27.671993 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converting VIF {"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:27.672700 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:27.673399 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lazy-loading 'pci_devices' on Instance uuid 173e3dc3-be91-41bc-b353-ecac928a7c90 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:27.706829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7ffb6f23-f17c-43ee-9233-75bb9d95d370 req-b6e9f66a-d1db-4896-9c22-c54560728f61 service nova] Releasing lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:27.707140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquired lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:27.707332 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:27.828284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-229577f4-58eb-4d17-9c92-273fcf744483 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.262s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:27.915036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:27.915263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <uuid>173e3dc3-be91-41bc-b353-ecac928a7c90</uuid>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <name>instance-00000033</name>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:name>tempest-instance-82425095</nova:name>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:24</nova:creationTime>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:user uuid="6abcc90720de4d3e8d49aa5c4bb02b11">tempest-VolumesBackupsTest-232973889-project-member</nova:user>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:project uuid="7a0a7fdd73fc40328c4c73ef53edc697">tempest-VolumesBackupsTest-232973889</nova:project>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         <nova:port uuid="c2f40694-6df1-42ed-87e8-dbf564e1b93e">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="serial">173e3dc3-be91-41bc-b353-ecac928a7c90</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="uuid">173e3dc3-be91-41bc-b353-ecac928a7c90</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.config"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <alias name="ua-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <serial>a5fbcabf-ce3a-4fad-9b90-c7b9003301d0</serial>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:f8:d9:e0"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <target dev="tapc2f40694-6d"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/console.log" append="off"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:28.179628 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Preparing to wait for external event network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-82425095',display_name='tempest-instance-82425095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-instance-82425095',id=51,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJJL90802W01rdKiBGumzKL49Bluvhm37UOGv5Q5xLi/mqbwWB18no25wTut6XBbW1xQCH2iw53Cbk6p9oX6a17n4v9GXO5oRhl3MHUTr+cUXt7ja/1u7GXMy0bDlgWDQ==',key_name='tempest-keypair-179190207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a0a7fdd73fc40328c4c73ef53edc697',ramdisk_id='',reservation_id='r-mofewi97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-232973889',owner_user_name='tempest-VolumesBackupsTest-232973889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abcc90720de4d3e8d49aa5c4bb02b11',uuid=173e3dc3-be91-41bc-b353-ecac928a7c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converting VIF {"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:28.181629 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:28.182142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.182415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:28.182987 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:28.184948 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.184948 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '345c87be-2276-5e6a-a3f4-603d4cef8e67', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:28.185689 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.186452 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:28.187202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.189792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.189792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2f40694-6d, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:28.190060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2f40694-6d, col_values=(('qos', UUID('b5133889-fdb7-472c-9efd-c2a4c91e95e3')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:28.190229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2f40694-6d, col_values=(('external_ids', {'iface-id': 'c2f40694-6df1-42ed-87e8-dbf564e1b93e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:d9:e0', 'vm-uuid': '173e3dc3-be91-41bc-b353-ecac928a7c90'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:28.190995 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.193524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:28.198979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:28.199992 np0000003683 nova-compute[98991]: INFO os_vif [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d')
Jun 26 02:50:28.206200 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:28.217818 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:28.223038 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:28.236534 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.247284 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.257679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.266072 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.266579 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.286903 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.290617 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:28.316002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:50:28.316002 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:28.316002 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.324907 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:28.333020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.344851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:50:28.344851 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:28.344851 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.356303 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.356978 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:28.357589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:28.357589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:28.358287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:28.359108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('16', '-', '-', 0) found on session 119 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:28.359108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:28.378355 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 119 and hctl ['16', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.382237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:28.382990 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:28.386335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:28.386585 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:28.388229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] HCTL ('18', '-', '-', 0) found on session 120 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:28.388375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:28.405362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 120 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:28.405554 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:28.418377 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Detaching volume 30e69043-4f4b-47f3-b252-4718d5d2e28b
Jun 26 02:50:28.472075 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Attempting to driver detach volume 30e69043-4f4b-47f3-b252-4718d5d2e28b from mountpoint /dev/vdb
Jun 26 02:50:28.475877 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:28.476967 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found disk vdb by alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:28.477088 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Attempting to detach device vdb from instance f0c513bb-680e-44fa-a657-c22de6578b1b from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:28.477329 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:28.482666 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance f0c513bb-680e-44fa-a657-c22de6578b1b from the persistent domain config.
Jun 26 02:50:28.482870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] (1/8): Attempting to detach device vdb with device alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b from instance f0c513bb-680e-44fa-a657-c22de6578b1b from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <alias name="ua-30e69043-4f4b-47f3-b252-4718d5d2e28b"/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <serial>30e69043-4f4b-47f3-b252-4718d5d2e28b</serial>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:28.483190 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:28.508839 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:28.663930 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updating instance_info_cache with network_info: [{"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:28.896384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:50:28.897381 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:50:28.897644 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Creating image(s)
Jun 26 02:50:28.898043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:50:28.898153 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Ensure instance console log exists: /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:28.898389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:28.898590 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:28.898730 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:29.166112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Releasing lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:29.166433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance network_info: |[{"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:50:29.167308 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Start _get_guest_xml network_info=[{"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ff1965e-35ec-4d42-8e7c-f18696a64da9', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '635540bc-bb17-41d4-82c3-39b742a7f65e', 'attached_at': '', 'detached_at': '', 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'serial': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:29.170220 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:29.171371 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-854453160', uuid='635540bc-bb17-41d4-82c3-39b742a7f65e'), owner=OwnerMeta(userid='dabf44f7bd7d4f0bb60de94c0db9de53', username='tempest-TestVolumeBootPatternV346-766983106-project-member', projectid='addc661d189b4a8c8e130200e4d2c30a', projectname='tempest-TestVolumeBootPatternV346-766983106'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442229.1710086) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:29.172755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:29.173071 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:29.174169 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:29.174303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:29.175264 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:29.175560 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:29.175733 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:29.175850 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:29.176007 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:29.176121 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:29.176255 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:29.176435 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:29.176589 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:29.176704 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:29.176801 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:29.177518 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:29.187993 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:29.188392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:29.188392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:29.377867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Searching for a device in session 119 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:29.378032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:29.487346 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004779290002261405 future=<Future at 0x72e27c27c4d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:29.487498 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:50:29.487978 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Emitting event <LifecycleEvent: 1782442214.4867427, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:29.488136 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Stopped (Lifecycle Event)
Jun 26 02:50:29.711880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:29.728709 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:29.728848 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:29.728992 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:29.729134 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] No VIF found with MAC fa:16:3e:f8:d9:e0, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:29.729664 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Using config drive
Jun 26 02:50:29.997947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:30.205990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found WWN 330000000844c6185 for multipath device dm-11 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:30.206360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:30.207009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.019s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:30.207313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:30.208521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000844c6185'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:30.208684 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000844c6185', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000844c6185'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:30.219326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:30.219895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:30.220092 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:30.220778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:30.221645 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:30.221903 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:30.236418 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:30.240054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:30.240054 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:30.241599 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'attaching', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '2026-06-26T02:50:26.000000', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:50:30.242055 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:50:30.242055 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:50:30.242055 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:50:30.242951 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:30.242951 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85] added
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:30.258999 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:30.259250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:30.259325 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:30.259455 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]:     <volume>54b441cb-7c4b-4d93-9731-7cd9bdc79018</volume>
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:50:30.269428 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85] added
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:30.269961 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:30.270285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:30.270382 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0484(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:30.270754 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:30.413017 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Creating config drive at /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.config
Jun 26 02:50:30.417142 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzt3k6t_y {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:30.472490 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzt3k6t_y" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:30.782555 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:10Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:30.782766 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:30.783494 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <uuid>126a33da-d066-4fbf-bb4c-5da1f41252ed</uuid>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <name>instance-00000030</name>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-388591585</nova:name>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:26</nova:creationTime>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:user uuid="13af0bfb96bf40179144f66af7baeed9">tempest-TestEncryptedCinderVolumes-1629371133-project-member</nova:user>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:project uuid="419e029cdd744c1598f7a9d2bcc52340">tempest-TestEncryptedCinderVolumes-1629371133</nova:project>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <nova:port uuid="0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="serial">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="uuid">126a33da-d066-4fbf-bb4c-5da1f41252ed</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk.config"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <encryption format="luks">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:         <secret type="passphrase" uuid="fde1ad13-1b69-43a5-819d-7cd3cdb816ab"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       </encryption>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1a:81:38"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <target dev="tap0cc1c496-63"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/console.log" append="off"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:30.785823 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Preparing to wait for external event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:10Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003683',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:30.787962 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:30.788259 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:30.788646 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.788972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:30.789299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:30.790423 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.790608 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26e2f714-6539-5e6d-bd98-49d058a1424b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:30.791329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.792358 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:30.798003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.800398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.800627 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cc1c496-63, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:30.800965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cc1c496-63, col_values=(('qos', UUID('974b8f23-5b46-4786-90fd-eb71a8b0c129')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:30.801163 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cc1c496-63, col_values=(('external_ids', {'iface-id': '0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:81:38', 'vm-uuid': '126a33da-d066-4fbf-bb4c-5da1f41252ed'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:30.802069 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.803673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:30.812106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.813490 np0000003683 nova-compute[98991]: INFO os_vif [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:50:30.884067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.925940 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:30.928818 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.085703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.208132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.214605 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.217838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.247302 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.254529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.259970 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:31.271244 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:31.273973 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:31.283862 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.289642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.296872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.311671 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.312385 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.318444 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.318976 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:31.363443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.40.100,3260]
Jun 26 02:50:31.363443 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:31.363443 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.376564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.384303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.50.100,3260]
Jun 26 02:50:31.384303 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:31.384303 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.396010 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.396557 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:31.396924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:31.396924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:31.397030 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:31.398566 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('20', '-', '-', 0) found on session 121 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:31.398712 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:31.412909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:31.418254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:31.420072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 121 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:31.420072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:31.426833 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] HCTL ('21', '-', '-', 0) found on session 122 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:31.426833 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:31.446666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Searching for a device in session 122 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:31.446666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:31.450894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.557922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.561193 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.751376 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.753368 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.754820 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.782588 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:31.971875 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442231.9714923, f0c513bb-680e-44fa-a657-c22de6578b1b => ua-30e69043-4f4b-47f3-b252-4718d5d2e28b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:50:31.973271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-30e69043-4f4b-47f3-b252-4718d5d2e28b for instance f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:50:31.978367 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully detached device vdb from instance f0c513bb-680e-44fa-a657-c22de6578b1b from the live domain config.
Jun 26 02:50:32.013473 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:50:32.013871 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:32.013971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:32.039819 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:32.222638 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442232.2223125, 173e3dc3-be91-41bc-b353-ecac928a7c90 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:32.222958 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] VM Started (Lifecycle Event)
Jun 26 02:50:32.224581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:50:32.725639 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:32.727792 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442232.727579, 173e3dc3-be91-41bc-b353-ecac928a7c90 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:32.727934 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] VM Paused (Lifecycle Event)
Jun 26 02:50:32.811182 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3e69754e-84c5-4182-a4b6-9eacce060c15 req-fa6b06a7-0943-4b37-9e56-d1b655754c4e service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:32.811383 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e69754e-84c5-4182-a4b6-9eacce060c15 req-fa6b06a7-0943-4b37-9e56-d1b655754c4e service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:32.811585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e69754e-84c5-4182-a4b6-9eacce060c15 req-fa6b06a7-0943-4b37-9e56-d1b655754c4e service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:32.811813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3e69754e-84c5-4182-a4b6-9eacce060c15 req-fa6b06a7-0943-4b37-9e56-d1b655754c4e service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:32.811866 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3e69754e-84c5-4182-a4b6-9eacce060c15 req-fa6b06a7-0943-4b37-9e56-d1b655754c4e service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Processing event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:33.172329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:33.172573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:33.196802 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:33.201493 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance running successfully.
Jun 26 02:50:33.201951 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] finish_revert_migration finished successfully. {{(pid=98991) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12999}}
Jun 26 02:50:33.230427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:33.233524 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:33.241533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Found WWN 33000000057f587a9 for multipath device dm-14 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:33.241927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:33.242316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== connect_volume: return (4053ms) {'type': 'block', 'scsi_wwn': '33000000057f587a9', 'path': '/dev/dm-14', 'multipath_id': '33000000057f587a9'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:33.242457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000057f587a9', 'path': '/dev/dm-14', 'multipath_id': '33000000057f587a9'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:33.243123 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.229s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:33.243521 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e69043-4f4b-47f3-b252-4718d5d2e28b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:50:33.243674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:33.279506 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:50:33.280050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:50:33.281201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:50:33.282187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4a4ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:50:33.282398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:50:33.282712 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flush multipath device 3300000007341c2f6 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:50:33.331562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:50:33.371112 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:50:33.410715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:50:33.410895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:50:33.412413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:50:33.422983 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:50:33.423177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:50:33.435537 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.476785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.40.100,3260]
Jun 26 02:50:33.476785 np0000003683 nova-compute[98991]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:33.476785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.499787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.512903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.551989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.50.100,3260]
Jun 26 02:50:33.551989 np0000003683 nova-compute[98991]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:33.551989 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.575050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:33.575322 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:33.575447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== disconnect_volume: return (1561ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:33.575703 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:50:33.675923 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:33.735724 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:50:33.736123 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442233.7359364, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:33.736415 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Started (Lifecycle Event)
Jun 26 02:50:33.748471 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-854453160',display_name='tempest-TestVolumeBootPatternV346-server-854453160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-854453160',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxt8CD6/IF9NEJb7WP0NQapMA8KzgIfAAhL7RBR6gNhX5hcO3Pa0PABnlU1vfXIFrnMdXU/ctqAdPVBKx6XRLBDjMe+neJzBZC5KThwVVz5O9N6kd4LpWE57mM07ivQ7A==',key_name='tempest-keypair-12928320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-rsusg69h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=635540bc-bb17-41d4-82c3-39b742a7f65e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:33.749051 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:33.749881 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:33.750762 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'pci_devices' on Instance uuid 635540bc-bb17-41d4-82c3-39b742a7f65e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:34.124339 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'flavor' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:34.180766 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Ignoring supplied device name: /dev/vdb
Jun 26 02:50:34.239020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:34.241115 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <uuid>635540bc-bb17-41d4-82c3-39b742a7f65e</uuid>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <name>instance-00000034</name>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPatternV346-server-854453160</nova:name>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:29</nova:creationTime>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:user uuid="dabf44f7bd7d4f0bb60de94c0db9de53">tempest-TestVolumeBootPatternV346-766983106-project-member</nova:user>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:project uuid="addc661d189b4a8c8e130200e4d2c30a">tempest-TestVolumeBootPatternV346-766983106</nova:project>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         <nova:port uuid="466b9e64-ee02-48ce-8d31-3c994089d383">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="serial">635540bc-bb17-41d4-82c3-39b742a7f65e</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="uuid">635540bc-bb17-41d4-82c3-39b742a7f65e</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/disk.config"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <alias name="ua-5013b4c0-b1f8-4e71-af85-cf8a7047cd85"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-14"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <serial>5013b4c0-b1f8-4e71-af85-cf8a7047cd85</serial>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1f:2c:fe"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <target dev="tap466b9e64-ee"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/console.log" append="off"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:34.254458 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Preparing to wait for external event network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-854453160',display_name='tempest-TestVolumeBootPatternV346-server-854453160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-854453160',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxt8CD6/IF9NEJb7WP0NQapMA8KzgIfAAhL7RBR6gNhX5hcO3Pa0PABnlU1vfXIFrnMdXU/ctqAdPVBKx6XRLBDjMe+neJzBZC5KThwVVz5O9N6kd4LpWE57mM07ivQ7A==',key_name='tempest-keypair-12928320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-rsusg69h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=635540bc-bb17-41d4-82c3-39b742a7f65e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:34.257228 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:34.258004 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:34.258932 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.263705 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4173ee77-d6df-4c5d-9258-ce4fd1b664f8 tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance to original state: 'active'
Jun 26 02:50:34.264635 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:34.265072 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:34.266789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.267189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbdc02ee-46d1-5001-90ee-a480bf049e73', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:34.267941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.268718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:34.269213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.271113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.271333 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap466b9e64-ee, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:34.271668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap466b9e64-ee, col_values=(('qos', UUID('5da0e160-4fcc-4c47-9a44-e80d48eafcc5')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:34.271810 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap466b9e64-ee, col_values=(('external_ids', {'iface-id': '466b9e64-ee02-48ce-8d31-3c994089d383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2c:fe', 'vm-uuid': '635540bc-bb17-41d4-82c3-39b742a7f65e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:34.272653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.273916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:34.278639 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.279300 np0000003683 nova-compute[98991]: INFO os_vif [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee')
Jun 26 02:50:34.400689 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:34.685185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:34.743142 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 26 02:50:34.743432 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442234.743203, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:34.743626 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Paused (Lifecycle Event)
Jun 26 02:50:34.909890 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:34.910198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:34.913986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:34.914286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:34.914286 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:34.914417 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-9c730274-4b55-4f77-b5ba-93af189d3cea req-b0ad96d9-96e8-4fe7-8d62-5d8362c732a6 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received unexpected event network-vif-plugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with vm_state active and task_state None.
Jun 26 02:50:34.940591 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:35.131754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d1e2d888-72f6-47e0-ae09-b15e39f6c35a tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.216s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:35.245813 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:35.247717 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442235.2472842, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:35.247877 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Resumed (Lifecycle Event)
Jun 26 02:50:35.753299 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:35.755815 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:35.767080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:35.767253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:35.767425 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Attaching volume e1d6f62f-72e0-42df-a20e-cf29b92618e0 to /dev/vdb
Jun 26 02:50:35.800706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:35.801152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:35.801152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] No VIF found with MAC fa:16:3e:1f:2c:fe, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:35.801687 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Using config drive
Jun 26 02:50:35.829373 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:35.843067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:50:35.866555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:35.918602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:50:35.918816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:50:35.931671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:50:35.932585 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c'] 
Jun 26 02:50:35.932850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:50:35.932947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:50:35.933149 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:35.933405 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updating existing volume attachment record: a72ad6ad-1b6d-4f86-88c5-7a4c836dcf24 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:50:36.085304 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:36.220347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:36.220526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:36.317733 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:36.434282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-831778aa-7de1-49aa-af36-f575a9572364 req-7fce68a9-02d6-4afb-9030-e7d9bf6bf8af service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:36.435119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-831778aa-7de1-49aa-af36-f575a9572364 req-7fce68a9-02d6-4afb-9030-e7d9bf6bf8af service nova] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:36.435360 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-831778aa-7de1-49aa-af36-f575a9572364 req-7fce68a9-02d6-4afb-9030-e7d9bf6bf8af service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:36.436743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-831778aa-7de1-49aa-af36-f575a9572364 req-7fce68a9-02d6-4afb-9030-e7d9bf6bf8af service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:36.436934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-831778aa-7de1-49aa-af36-f575a9572364 req-7fce68a9-02d6-4afb-9030-e7d9bf6bf8af service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Processing event network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:36.437406 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:36.443800 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442236.4433472, 173e3dc3-be91-41bc-b353-ecac928a7c90 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:36.443900 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] VM Resumed (Lifecycle Event)
Jun 26 02:50:36.446337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:50:36.453407 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance spawned successfully.
Jun 26 02:50:36.453407 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:50:36.495744 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Creating config drive at /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/disk.config
Jun 26 02:50:36.500503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:36.500503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:36.500503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:36.500503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:36.500503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:36.504633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuf45nhpl {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:36.524662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:36.529904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:36.534347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:36.534347 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:36.535008 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:36.535008 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:36.551055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:36.551055 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:36.562933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:36.562933 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:36.571739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuf45nhpl" returned: 0 in 0.069s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0] added
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:36.573767 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:36.574067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:36.574309 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0414(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:36.574502 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0] added
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:36.580585 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:36.580831 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:36.581011 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:36.581238 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:36.724701 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Detaching volume 54b441cb-7c4b-4d93-9731-7cd9bdc79018
Jun 26 02:50:36.786006 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Attempting to driver detach volume 54b441cb-7c4b-4d93-9731-7cd9bdc79018 from mountpoint /dev/vdb
Jun 26 02:50:36.826423 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'attaching', 'instance': '126a33da-d066-4fbf-bb4c-5da1f41252ed', 'attached_at': '2026-06-26T02:50:26.000000', 'detached_at': '', 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'serial': '54b441cb-7c4b-4d93-9731-7cd9bdc79018'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:50:36.836645 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:36.838560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:50:36.838754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Attempting to detach device vdb from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="fde1ad13-1b69-43a5-819d-7cd3cdb816ab"/>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:36.839019 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the persistent domain config.
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] (1/8): Attempting to detach device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="fde1ad13-1b69-43a5-819d-7cd3cdb816ab"/>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:36.859130 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:50:36.948116 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:36.950113 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:36.961261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:36.961466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:36.962437 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:36.962812 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:36.964688 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:36.965533 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:37.044954 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.055033 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.093389 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.096975 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.199866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.252838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.254356 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:37.457316 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:50:37.476314 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Took 13.89 seconds to spawn the instance on the hypervisor.
Jun 26 02:50:37.476314 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:37.575010 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:37.581692 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:37.596586 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:37.600057 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.616043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.629885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.649590 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.650575 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:37.714988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.40.100,3260]
Jun 26 02:50:37.714988 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:37.714988 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.728967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.729544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.50.100,3260]
Jun 26 02:50:37.729544 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:37.729544 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.751719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.753267 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.753693 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:37.754011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:37.754011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:37.755060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] HCTL ('7', '-', '-', 0) found on session 123 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:37.755165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:37.772559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching for a device in session 123 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:37.772559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.779699 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:37.780059 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:37.780413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.246s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:37.780413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:37.782128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] HCTL ('9', '-', '-', 0) found on session 124 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:37.782317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:37.812665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching for a device in session 124 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:37.812665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:37.988849 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Took 21.83 seconds to build instance.
Jun 26 02:50:38.034293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:38.034565 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:38.063069 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442238.0626245, 635540bc-bb17-41d4-82c3-39b742a7f65e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:38.063168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] VM Started (Lifecycle Event)
Jun 26 02:50:38.492523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-042b6c4e-35de-4bb5-9a4f-efd2b0e4bbda tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.345s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:38.515372 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:38.516143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:38.516359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:38.516547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:38.519725 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] No waiting events found dispatching network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:38.519894 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-427982d6-e3bc-4e04-b05b-1508a7cd55d9 req-9987a0b1-d9af-4ccc-a381-cb2da8c814b1 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received unexpected event network-vif-plugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e for instance with vm_state active and task_state None.
Jun 26 02:50:38.535047 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:50:38.536289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:50:38.566077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:38.568432 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442238.5681734, 635540bc-bb17-41d4-82c3-39b742a7f65e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:38.568580 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] VM Paused (Lifecycle Event)
Jun 26 02:50:39.070890 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:39.074198 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:39.097312 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:39.098021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:39.105810 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:50:39.106288 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Claim successful on node np0000003683
Jun 26 02:50:39.288721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:39.554551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found WWN 330000000f4065274 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:39.554888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:39.554941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== connect_volume: return (3057ms) {'type': 'block', 'scsi_wwn': '330000000f4065274', 'path': '/dev/dm-1', 'multipath_id': '330000000f4065274'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:39.555151 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f4065274', 'path': '/dev/dm-1', 'multipath_id': '330000000f4065274'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:39.558072 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:39.576356 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:50:39.713593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:39.713593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:39.740665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-changed-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:39.740774 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Refreshing instance network info cache due to event network-changed-c2f40694-6df1-42ed-87e8-dbf564e1b93e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:39.740927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] Acquiring lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:39.741013 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] Acquired lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:39.741137 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Refreshing network info cache for port c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:40.060951 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Attempting to attach volume e1d6f62f-72e0-42df-a20e-cf29b92618e0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:   <alias name="ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0"/>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:   <serial>e1d6f62f-72e0-42df-a20e-cf29b92618e0</serial>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:50:40.062292 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:50:40.214836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:50:40.245107 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:40.625915 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:40.805711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:40.810858 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updated VIF entry in instance network info cache for port c2f40694-6df1-42ed-87e8-dbf564e1b93e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:50:40.811144 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updating instance_info_cache with network_info: [{"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:40.844166 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:40.844372 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:41.044226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:41.313558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4c110933-6711-4024-98de-e88541917559 req-7af45b00-a1bb-44be-8fef-fe70862203ef service nova] Releasing lock "refresh_cache-173e3dc3-be91-41bc-b353-ecac928a7c90" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:41.349996 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:41.753882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:41.754373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:41.754373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:41.754373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No VIF found with MAC fa:16:3e:b5:b1:0f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:41.856706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.759s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:41.857024 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:50:41.862823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.057s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:41.863414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 for instance 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:50:41.871097 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:50:41.871097 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Claim successful on node np0000003683
Jun 26 02:50:42.010653 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1ceb4645-f1e8-4de6-aa6a-b74884ade4a4 req-72b42e2c-b601-453c-8798-6f0e83149719 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:42.010865 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ceb4645-f1e8-4de6-aa6a-b74884ade4a4 req-72b42e2c-b601-453c-8798-6f0e83149719 service nova] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:42.010958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ceb4645-f1e8-4de6-aa6a-b74884ade4a4 req-72b42e2c-b601-453c-8798-6f0e83149719 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:42.011071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ceb4645-f1e8-4de6-aa6a-b74884ade4a4 req-72b42e2c-b601-453c-8798-6f0e83149719 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:42.011178 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1ceb4645-f1e8-4de6-aa6a-b74884ade4a4 req-72b42e2c-b601-453c-8798-6f0e83149719 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Processing event network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:42.011751 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:42.015458 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442242.0142956, 635540bc-bb17-41d4-82c3-39b742a7f65e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:42.015458 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] VM Resumed (Lifecycle Event)
Jun 26 02:50:42.016036 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:50:42.017906 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance spawned successfully.
Jun 26 02:50:42.018161 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:50:42.044958 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:42.363358 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:50:42.363527 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:50:42.363830 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:42.363989 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:42.517521 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:42.526145 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.535504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:42.602683 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '384ade070e904d66a01f872d9b2c649d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b74afe940c40d490cd930d9056fc92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:50:42.867194 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:50:43.031590 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:50:43.049110 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Took 14.15 seconds to spawn the instance on the hypervisor.
Jun 26 02:50:43.049110 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:43.293283 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Successfully created port: 37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:50:43.316948 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2633a3ca-6a4f-4cc1-89ed-06bb2da50fe6 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.549s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:43.360669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:43.370733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:50:43.571354 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Took 21.83 seconds to build instance.
Jun 26 02:50:43.685934 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:43.686954 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:43.876407 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Booting with volume bcdb2e89-1965-4d17-9c10-c1c41155586a at /dev/vda
Jun 26 02:50:43.929793 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Successfully updated port: 37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:50:43.932611 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:43.944184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:50:43.963444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:44.014439 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:50:44.014741 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:50:44.023397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:50:44.025355 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe1f:2cfe'] 
Jun 26 02:50:44.025570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:50:44.025754 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:50:44.026061 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:44.026359 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Updating existing volume attachment record: 09299c39-473f-4b17-bebf-cc1292b73d68 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:50:44.071395 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:44.071907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:44.072109 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:44.072272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:44.072427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] No waiting events found dispatching network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:44.072674 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received unexpected event network-vif-plugged-466b9e64-ee02-48ce-8d31-3c994089d383 for instance with vm_state active and task_state None.
Jun 26 02:50:44.072857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-changed-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:44.073020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Refreshing instance network info cache due to event network-changed-37932b3e-c431-4b21-ace5-057910d8bd76. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:44.073152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Acquiring lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:44.073251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Acquired lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:44.073359 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Refreshing network info cache for port 37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:44.078877 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.342s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:44.189081 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:44.290159 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:44.403561 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-changed-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:44.403683 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Refreshing instance network info cache due to event network-changed-466b9e64-ee02-48ce-8d31-3c994089d383. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:44.403811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] Acquiring lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:44.403959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] Acquired lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:44.404131 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Refreshing network info cache for port 466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:44.438723 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:44.578717 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:44.640819 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:44.696113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.833s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:44.696639 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:50:44.796453 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:44.906174 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:45.205221 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:50:45.205928 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:50:45.206351 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:45.206649 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:45.289562 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:45.291389 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '389a3af6a1da43a1ae34023f109f7e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9d0803e00c49998563cf202a69ab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:50:45.300741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2de3d82a-646d-4b5c-94a1-bf76b5ed9817 req-16238d83-f0f2-4a86-a5ae-aca88a3508bd service nova] Releasing lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:45.301028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquired lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:45.301215 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:45.457454 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updated VIF entry in instance network info cache for port 466b9e64-ee02-48ce-8d31-3c994089d383. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:50:45.457724 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updating instance_info_cache with network_info: [{"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:45.709656 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:50:45.873319 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:45.913758 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Successfully created port: 2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:50:45.961050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-949a5163-16a1-405a-8512-0eac6c67cb3c req-14bd8b86-8ffc-4d73-b66b-9f5863ce4642 service nova] Releasing lock "refresh_cache-635540bc-bb17-41d4-82c3-39b742a7f65e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:46.080689 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:46.147781 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:50:46.148780 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:50:46.149013 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Creating image(s)
Jun 26 02:50:46.150136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:50:46.150136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Ensure instance console log exists: /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:46.150136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:46.150136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:46.150136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:46.212720 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:50:46.247872 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Updating instance_info_cache with network_info: [{"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:46.340884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:46.341042 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:46.544491 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Successfully updated port: 2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:50:46.598395 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-changed-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:46.598614 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Refreshing instance network info cache due to event network-changed-2d6c16e0-1ffb-49ce-a757-75d545befceb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:46.598831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] Acquiring lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:46.598954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] Acquired lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:46.599105 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Refreshing network info cache for port 2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:46.749965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Releasing lock "refresh_cache-49030d5d-0dbf-4ed0-9593-60522ecb32f6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:46.750458 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance network_info: |[{"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:50:46.751014 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Start _get_guest_xml network_info=[{"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '09299c39-473f-4b17-bebf-cc1292b73d68', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49030d5d-0dbf-4ed0-9593-60522ecb32f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'serial': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'multiattach': True}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:46.757936 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:46.759410 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-946218523', uuid='49030d5d-0dbf-4ed0-9593-60522ecb32f6'), owner=OwnerMeta(userid='384ade070e904d66a01f872d9b2c649d', username='tempest-AttachVolumeMultiAttachTest-1323859006-project-member', projectid='f2b74afe940c40d490cd930d9056fc92', projectname='tempest-AttachVolumeMultiAttachTest-1323859006'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442246.7589412) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:46.761314 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:46.761769 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:46.764295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:46.764659 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:46.766053 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:46.766414 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:46.766595 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:46.766720 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:46.766867 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:46.766981 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:46.767106 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:46.767308 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:46.767439 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:46.769295 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:46.769443 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:46.769627 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:46.796249 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:50:46.796249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:50:46.797598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:46.797598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:46.797892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:50:46.812107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:46.812560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:46.812816 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:46.813362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:50:46.813982 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:50:46.814249 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:46.829667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:46.829667 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:46.831269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:50:46.831269 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:46.843522 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a] added
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:46.852901 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:46.853251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:46.853366 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:46.853993 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a] added
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:50:46.856608 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:46.857058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:50:46.857295 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.043(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:50:46.857501 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:50:47.047693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:47.048257 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:47.101974 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:47.179849 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:47.226729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:50:47.227591 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:50:47.227853 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Creating image(s)
Jun 26 02:50:47.228309 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:47.228520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:47.228935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:47.229578 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:47.232338 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:47.233416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:47.347884 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.110s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:47.351976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:47.355063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:47.355656 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:47.359096 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:47.363069 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:47.372243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:47.433145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:47.433424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:47.441140 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:50:47.441508 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Claim successful on node np0000003683
Jun 26 02:50:47.467005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:47.467467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:47.541840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk 1073741824" returned: 0 in 0.073s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:47.541840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:47.542128 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:47.658381 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.116s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:47.658826 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:50:47.659068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:47.751839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:47.753058 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Cannot resize image /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:50:47.753539 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:50:47.753747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Ensure instance console log exists: /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:47.754041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:47.754289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:47.754461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:47.854093 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:50:47.857995 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:50:47.868888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21652f5f-1c82-40eb-99fa-53e877c2fa55 req-5f638a53-b8bf-4369-8986-02965de0e7b1 service nova] Releasing lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:47.870357 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:47.873088 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquired lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:47.873088 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:50:47.875548 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:47.888823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:47.895844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.914382 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.951442 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:47.952510 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:47.983919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.50.100,3260]
Jun 26 02:50:47.983919 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.50.100,3260] successful.
Jun 26 02:50:47.983919 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:48.000509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.039279 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.039839 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:48.040134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:48.040134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:48.040722 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.40.100,3260]
Jun 26 02:50:48.040722 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.40.100,3260] successful.
Jun 26 02:50:48.040722 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:48.042857 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('23', '-', '-', 0) found on session 127 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:48.043003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:48.059374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:50:48.075184 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 127 and hctl ['23', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.289s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] HCTL ('24', '-', '-', 0) found on session 128 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:50:48.103127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:50:48.127785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 128 and hctl ['24', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:48.470225 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:48.703350 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:48.910408 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating instance_info_cache with network_info: [{"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:49.075952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 127 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:49.076552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:49.128408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Searching for a device in session 128 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:50:49.128606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:50:49.248810 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:49.249066 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:49.292077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.345271 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:49.345762 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:50:49.413003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Releasing lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:49.413300 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance network_info: |[{"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:50:49.415119 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Start _get_guest_xml network_info=[{"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:49.417293 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:49.418506 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-391180148', uuid='89077a65-79ce-406a-9fca-bcbac51a89ba'), owner=OwnerMeta(userid='389a3af6a1da43a1ae34023f109f7e77', username='tempest-TestServerVolumeAttachmentScenario-1484440150-project-member', projectid='1d9d0803e00c49998563cf202a69ab1c', projectname='tempest-TestServerVolumeAttachmentScenario-1484440150'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442249.4181466) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:49.419809 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:49.420158 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:49.421190 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:49.421374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:49.422297 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:49.422670 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:49.422849 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:49.422977 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:49.423128 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:49.423254 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:49.423378 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:49.423594 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:49.423731 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:49.423863 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:49.423991 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:49.424148 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:49.434408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-391180148',display_name='tempest-TestServerVolumeAttachmentScenario-server-391180148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachmentscenario-server-391180148',id=54,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC51CyIcFEGDiRsMcjFpR9lmO6HxUTshd1FX10B2d28YBVqGCxOfUVH2kGPpmAmplIMM7qGsb/noipKiScSnDw/oYr1ZQam+ifr3t1hzTDWxZz5FWdzscFDJHeQLG2o+jg==',key_name='tempest-keypair-1115511862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d9d0803e00c49998563cf202a69ab1c',ramdisk_id='',reservation_id='r-g2s8d0o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1484440150',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1484440150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='389a3af6a1da43a1ae34023f109f7e77',uuid=89077a65-79ce-406a-9fca-bcbac51a89ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:49.434654 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converting VIF {"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:49.435145 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:49.435682 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'pci_devices' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:49.751751 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:49.815152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <uuid>89077a65-79ce-406a-9fca-bcbac51a89ba</uuid>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <name>instance-00000036</name>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-391180148</nova:name>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:49</nova:creationTime>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:user uuid="389a3af6a1da43a1ae34023f109f7e77">tempest-TestServerVolumeAttachmentScenario-1484440150-project-member</nova:user>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:project uuid="1d9d0803e00c49998563cf202a69ab1c">tempest-TestServerVolumeAttachmentScenario-1484440150</nova:project>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         <nova:port uuid="2d6c16e0-1ffb-49ce-a757-75d545befceb">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="serial">89077a65-79ce-406a-9fca-bcbac51a89ba</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="uuid">89077a65-79ce-406a-9fca-bcbac51a89ba</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.config"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:58:ad:7f"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <target dev="tap2d6c16e0-1f"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/console.log" append="off"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:49.938828 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Preparing to wait for external event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-391180148',display_name='tempest-TestServerVolumeAttachmentScenario-server-391180148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachmentscenario-server-391180148',id=54,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC51CyIcFEGDiRsMcjFpR9lmO6HxUTshd1FX10B2d28YBVqGCxOfUVH2kGPpmAmplIMM7qGsb/noipKiScSnDw/oYr1ZQam+ifr3t1hzTDWxZz5FWdzscFDJHeQLG2o+jg==',key_name='tempest-keypair-1115511862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d9d0803e00c49998563cf202a69ab1c',ramdisk_id='',reservation_id='r-g2s8d0o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1484440150',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1484440150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='389a3af6a1da43a1ae34023f109f7e77',uuid=89077a65-79ce-406a-9fca-bcbac51a89ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converting VIF {"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:49.942250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:49.943555 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.943741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '734331c8-63e8-5d1d-aac6-2d36e0f8b8ec', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:49.950908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.951966 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:49.958713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.958874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d6c16e0-1f, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:49.959314 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d6c16e0-1f, col_values=(('qos', UUID('44e2372f-094d-4b88-8695-d459be0778d7')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:49.959510 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d6c16e0-1f, col_values=(('external_ids', {'iface-id': '2d6c16e0-1ffb-49ce-a757-75d545befceb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:ad:7f', 'vm-uuid': '89077a65-79ce-406a-9fca-bcbac51a89ba'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:49.960428 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.962004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:49.974439 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:49.975578 np0000003683 nova-compute[98991]: INFO os_vif [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f')
Jun 26 02:50:50.258548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.825s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:50.259040 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:50:50.343855 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:50.764352 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:50:50.764534 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:50:50.764768 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:50.765460 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:50.831120 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Found WWN 33000000098a226c8 for multipath device dm-17 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:50:50.831433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:50:50.831665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '33000000098a226c8', 'path': '/dev/dm-17', 'multipath_id': '33000000098a226c8'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:50:50.831785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098a226c8', 'path': '/dev/dm-17', 'multipath_id': '33000000098a226c8'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:50:50.846820 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2e15651c2d142d9838bb7a85863b775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91d5830f544432d89b9c8613c0a99c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:50:50.849916 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:50.850339 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:50.851081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:50.851081 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:50:51.268500 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:50:51.284498 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Successfully created port: 2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:50:51.342638 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-946218523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-946218523',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-8klk3vwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:43Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=49030d5d-0dbf-4ed0-9593-60522ecb32f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:51.342862 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:51.343360 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:51.343861 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'pci_devices' on Instance uuid 49030d5d-0dbf-4ed0-9593-60522ecb32f6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:51.495134 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:51.495403 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:51.495403 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No VIF found with MAC fa:16:3e:58:ad:7f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:51.495867 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Using config drive
Jun 26 02:50:51.771626 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <uuid>49030d5d-0dbf-4ed0-9593-60522ecb32f6</uuid>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <name>instance-00000035</name>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-946218523</nova:name>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:46</nova:creationTime>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:user uuid="384ade070e904d66a01f872d9b2c649d">tempest-AttachVolumeMultiAttachTest-1323859006-project-member</nova:user>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:project uuid="f2b74afe940c40d490cd930d9056fc92">tempest-AttachVolumeMultiAttachTest-1323859006</nova:project>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         <nova:port uuid="37932b3e-c431-4b21-ace5-057910d8bd76">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="serial">49030d5d-0dbf-4ed0-9593-60522ecb32f6</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="uuid">49030d5d-0dbf-4ed0-9593-60522ecb32f6</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/disk.config"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <alias name="ua-bcdb2e89-1965-4d17-9c10-c1c41155586a"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-17"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <serial>bcdb2e89-1965-4d17-9c10-c1c41155586a</serial>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <shareable/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:13:e1:16"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <target dev="tap37932b3e-c4"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/console.log" append="off"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:51.848101 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Preparing to wait for external event network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-946218523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-946218523',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-8klk3vwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:43Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=49030d5d-0dbf-4ed0-9593-60522ecb32f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:51.850275 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:51.851358 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.851358 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:51.851358 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:51.852817 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.852817 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b3d0723-e1a1-5d3f-8f99-41e0dcb2ff45', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:51.854096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.854096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:51.863377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.867309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.867309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37932b3e-c4, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:51.867309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37932b3e-c4, col_values=(('qos', UUID('c1782f53-96a2-4ffd-93ef-59a74d0c5da2')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:51.867309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37932b3e-c4, col_values=(('external_ids', {'iface-id': '37932b3e-c431-4b21-ace5-057910d8bd76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:e1:16', 'vm-uuid': '49030d5d-0dbf-4ed0-9593-60522ecb32f6'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:51.869422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.869422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:51.879553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:51.879959 np0000003683 nova-compute[98991]: INFO os_vif [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4')
Jun 26 02:50:51.889870 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Successfully updated port: 2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:50:51.898162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-14 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:51.899797 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:51.903033 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:51.904698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.002657 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:52.006234 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.008900 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.011702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-changed-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:52.011980 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Refreshing instance network info cache due to event network-changed-2752dbce-fa25-4a75-a19d-8cecb30dab47. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:52.013290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] Acquiring lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:52.013290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] Acquired lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:52.013290 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Refreshing network info cache for port 2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:52.054394 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:52.124146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.124616 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:52.129163 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:52.130896 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.187977 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Creating config drive at /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.config
Jun 26 02:50:52.192873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hs94pms {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.236653 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.237506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.288503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hs94pms" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.342249 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.347505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.396296 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:52.443793 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.444319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.539507 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:52.544166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.544574 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-11 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:52.553121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.633506 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:52.660426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.661907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.771023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.776057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.793042 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:50:52.796023 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:50:52.796423 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Creating image(s)
Jun 26 02:50:52.797586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:52.797960 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:52.798705 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:52.799777 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:52.806503 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:52.808044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:52.814253 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:52.819334 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.845691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:52.905372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.906242 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:52.934211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:52.935989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:52.936241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:52.937446 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:52.950851 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:50:52.950851 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.020541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.025638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.056900 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:53.064805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.065519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.097065 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-aac5615e-9080-4dbe-a50a-8712c57390ae req-4b82d819-1620-4a78-893f-c7155cef822c service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:53.097874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-aac5615e-9080-4dbe-a50a-8712c57390ae req-4b82d819-1620-4a78-893f-c7155cef822c service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:53.098162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-aac5615e-9080-4dbe-a50a-8712c57390ae req-4b82d819-1620-4a78-893f-c7155cef822c service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:53.099263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-aac5615e-9080-4dbe-a50a-8712c57390ae req-4b82d819-1620-4a78-893f-c7155cef822c service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:53.099263 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-aac5615e-9080-4dbe-a50a-8712c57390ae req-4b82d819-1620-4a78-893f-c7155cef822c service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Processing event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:53.128569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.128887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.146851 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk 1073741824" returned: 0 in 0.080s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.148154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:53.149181 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.248125 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.248125 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:50:53.248979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.267720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:53.274232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.275617 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:50:53.283726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.307106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:53.316567 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4fd266e0-28cd-4c7b-83b9-f169c32ef3e1 req-0fe35556-ae46-4b4e-be80-2b41231e2eb5 service nova] Releasing lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:53.319623 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquired lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:53.320456 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:50:53.376533 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.376982 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Cannot resize image /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:50:53.377414 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:50:53.377640 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Ensure instance console log exists: /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:50:53.379642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:53.379642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:53.379642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:53.393661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.394150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.427588 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:53.427941 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:53.428070 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] No VIF found with MAC fa:16:3e:13:e1:16, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:53.429747 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Using config drive
Jun 26 02:50:53.497074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.500764 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.685410 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.686128 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.849801 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:53.850402 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442253.850036, 89077a65-79ce-406a-9fca-bcbac51a89ba => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:53.850598 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] VM Started (Lifecycle Event)
Jun 26 02:50:53.854857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:50:53.861121 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance spawned successfully.
Jun 26 02:50:53.863349 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:50:53.880966 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.885114 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:53.886368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:53.917049 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:50:53.946978 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:53.954767 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:53.955177 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=48064MB free_disk=73.09659957885742GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:50:53.955284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:53.955530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:54.140018 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Creating config drive at /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/disk.config
Jun 26 02:50:54.144274 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1s95gmyz {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:54.207566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1s95gmyz" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:54.355830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:54.360286 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:54.369880 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.370086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.370432 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.370760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.371112 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.371858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:54.654821 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:54.699967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:54.739448 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:54.743853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:54.839918 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:54.856924 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Updating instance_info_cache with network_info: [{"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:54.864563 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:50:54.864563 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442254.863386, 89077a65-79ce-406a-9fca-bcbac51a89ba => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:54.864563 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] VM Paused (Lifecycle Event)
Jun 26 02:50:54.877662 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Took 7.65 seconds to spawn the instance on the hypervisor.
Jun 26 02:50:54.877929 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:54.937988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:54.939021 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.018839 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.018963 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019062 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 438d9a42-bd81-4489-8c87-68f146dfc61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019147 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ecba11d0-cb36-45bd-afce-8a4a2666c369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019288 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019375 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 34177e20-827a-4fcf-a802-1e99eee882e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019454 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance f0c513bb-680e-44fa-a657-c22de6578b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019574 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ed2fc500-5e0c-41d9-a529-cf132bff27be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019676 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 126a33da-d066-4fbf-bb4c-5da1f41252ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019725 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 173e3dc3-be91-41bc-b353-ecac928a7c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019799 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 635540bc-bb17-41d4-82c3-39b742a7f65e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.019873 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 49030d5d-0dbf-4ed0-9593-60522ecb32f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.020175 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 89077a65-79ce-406a-9fca-bcbac51a89ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.020175 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 49c705bc-074f-4fae-a607-2a8e0c33e066 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:50:55.020306 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 14 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:50:55.020351 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=3328MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:50:53 up 37 min,  2 users,  load average: 9.04, 7.85, 4.77\n', 'num_instances': '14', 'num_vm_active': '11', 'num_task_None': '11', 'num_os_type_None': '14', 'num_proj_f2b74afe940c40d490cd930d9056fc92': '6', 'io_workload': '3', 'num_proj_addc661d189b4a8c8e130200e4d2c30a': '3', 'num_proj_419e029cdd744c1598f7a9d2bcc52340': '1', 'num_proj_c05f689c58a04254b3930f0cc279148c': '1', 'num_proj_7a0a7fdd73fc40328c4c73ef53edc697': '1', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_1d9d0803e00c49998563cf202a69ab1c': '1', 'num_proj_b91d5830f544432d89b9c8613c0a99c6': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:50:55.154787 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:55.155022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:55.155270 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:55.155425 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:55.155618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:55.156280 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received unexpected event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with vm_state active and task_state None.
Jun 26 02:50:55.156280 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:55.156280 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:55.156280 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:55.156460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:55.156460 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Processing event network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] No waiting events found dispatching network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:50:55.159512 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1469704c-cd6d-40ab-8727-81a63742186f req-752e3d84-9111-4881-996b-3ff1cddf2fe8 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received unexpected event network-vif-plugged-37932b3e-c431-4b21-ace5-057910d8bd76 for instance with vm_state building and task_state spawning.
Jun 26 02:50:55.362946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Releasing lock "refresh_cache-49c705bc-074f-4fae-a607-2a8e0c33e066" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:55.363454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance network_info: |[{"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:50:55.364536 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Start _get_guest_xml network_info=[{"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:50:55.370007 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:55.374977 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:50:55.376235 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-147715695', uuid='49c705bc-074f-4fae-a607-2a8e0c33e066'), owner=OwnerMeta(userid='d2e15651c2d142d9838bb7a85863b775', username='tempest-VolumesActionsTest-1779422939-project-member', projectid='b91d5830f544432d89b9c8613c0a99c6', projectname='tempest-VolumesActionsTest-1779422939'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442255.3758147) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:50:55.379673 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442255.3780658, 89077a65-79ce-406a-9fca-bcbac51a89ba => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:55.379673 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] VM Resumed (Lifecycle Event)
Jun 26 02:50:55.380883 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:50:55.381267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:50:55.383460 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:50:55.383697 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:50:55.385584 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:50:55.385584 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:50:55.385584 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:50:55.385791 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:50:55.385834 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:50:55.386007 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:50:55.386087 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:50:55.386316 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:50:55.386574 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:50:55.387072 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:50:55.387170 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:50:55.387323 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:50:55.402408 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Took 14.68 seconds to build instance.
Jun 26 02:50:55.405914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-147715695',display_name='tempest-VolumesActionsTest-instance-147715695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-147715695',id=55,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-1xn7rnbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:52Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=49c705bc-074f-4fae-a607-2a8e0c33e066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:50:55.406230 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:55.406712 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:55.407244 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c705bc-074f-4fae-a607-2a8e0c33e066 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:50:55.607853 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:55.610177 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:50:55.615102 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance spawned successfully.
Jun 26 02:50:55.616503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:50:55.757617 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:50:55.757919 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:50:55.882690 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:55.884427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:55.905520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.193s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <uuid>49c705bc-074f-4fae-a607-2a8e0c33e066</uuid>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <name>instance-00000037</name>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesActionsTest-instance-147715695</nova:name>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:50:55</nova:creationTime>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:user uuid="d2e15651c2d142d9838bb7a85863b775">tempest-VolumesActionsTest-1779422939-project-member</nova:user>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:project uuid="b91d5830f544432d89b9c8613c0a99c6">tempest-VolumesActionsTest-1779422939</nova:project>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         <nova:port uuid="2752dbce-fa25-4a75-a19d-8cecb30dab47">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="serial">49c705bc-074f-4fae-a607-2a8e0c33e066</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="uuid">49c705bc-074f-4fae-a607-2a8e0c33e066</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.config"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:c1:ac:a1"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <target dev="tap2752dbce-fa"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/console.log" append="off"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:50:55.910164 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Preparing to wait for external event network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-147715695',display_name='tempest-VolumesActionsTest-instance-147715695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-147715695',id=55,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-1xn7rnbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:50:52Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=49c705bc-074f-4fae-a607-2a8e0c33e066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:50:55.913127 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:50:55.917643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.917972 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:55.918227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:50:55.920366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.920554 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8cfc8bf-fc4e-574c-baed-a58fe21e729e', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:55.921680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.922338 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:55.927267 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.929753 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.929960 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2752dbce-fa, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:55.930290 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2752dbce-fa, col_values=(('qos', UUID('181bceec-e540-4564-bd88-7e8edc649d95')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:55.930442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2752dbce-fa, col_values=(('external_ids', {'iface-id': '2752dbce-fa25-4a75-a19d-8cecb30dab47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ac:a1', 'vm-uuid': '49c705bc-074f-4fae-a607-2a8e0c33e066'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:50:55.934225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:50:55.939238 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:55.940410 np0000003683 nova-compute[98991]: INFO os_vif [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa')
Jun 26 02:50:56.127903 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.128210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.128620 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.132850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.132850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.132850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:50:56.261220 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:50:56.387989 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442256.387624, 49030d5d-0dbf-4ed0-9593-60522ecb32f6 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:56.389617 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] VM Started (Lifecycle Event)
Jun 26 02:50:56.640284 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Took 10.49 seconds to spawn the instance on the hypervisor.
Jun 26 02:50:56.640284 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:56.768566 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:50:56.768566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.813s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:56.769010 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:50:56.891168 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:56.893799 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:56.935867 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-changed-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:56.936422 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Refreshing instance network info cache due to event network-changed-2d6c16e0-1ffb-49ce-a757-75d545befceb. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:50:56.936671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] Acquiring lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:50:56.936794 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] Acquired lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:50:56.936945 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Refreshing network info cache for port 2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:50:57.053631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:57.152725 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Took 18.11 seconds to build instance.
Jun 26 02:50:57.397412 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442257.3970544, 49030d5d-0dbf-4ed0-9593-60522ecb32f6 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:57.397908 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] VM Paused (Lifecycle Event)
Jun 26 02:50:57.439589 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:57.461106 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:57.461382 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:50:57.461511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No VIF found with MAC fa:16:3e:c1:ac:a1, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:50:57.462091 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Using config drive
Jun 26 02:50:57.655986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83c3a07b-fa2e-4795-9ebd-d9226afa0894 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.621s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:57.836302 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:57.901657 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:57.904251 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442257.9038906, 49030d5d-0dbf-4ed0-9593-60522ecb32f6 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:57.904447 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] VM Resumed (Lifecycle Event)
Jun 26 02:50:57.971314 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:50:58.021003 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updated VIF entry in instance network info cache for port 2d6c16e0-1ffb-49ce-a757-75d545befceb. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:50:58.021493 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating instance_info_cache with network_info: [{"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:50:58.134184 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Creating config drive at /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.config
Jun 26 02:50:58.138666 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu1bcqpxr {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:50:58.192450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu1bcqpxr" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:50:58.408767 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:50:58.418356 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:50:58.524927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bed4e0b0-1d77-4155-9c68-3fe5911c25ee req-b5fe3101-cc03-4ae8-bc5c-de98cb868078 service nova] Releasing lock "refresh_cache-89077a65-79ce-406a-9fca-bcbac51a89ba" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:50:58.640371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:58.681390 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:58.770860 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:58.865641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a077aee-a993-4d70-b6c8-6a68a8b85a40 req-55d8eeda-5896-4056-8386-6aa7ab920ad6 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:50:58.865641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a077aee-a993-4d70-b6c8-6a68a8b85a40 req-55d8eeda-5896-4056-8386-6aa7ab920ad6 service nova] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:50:58.865641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a077aee-a993-4d70-b6c8-6a68a8b85a40 req-55d8eeda-5896-4056-8386-6aa7ab920ad6 service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:50:58.865641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a077aee-a993-4d70-b6c8-6a68a8b85a40 req-55d8eeda-5896-4056-8386-6aa7ab920ad6 service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:50:58.865641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a077aee-a993-4d70-b6c8-6a68a8b85a40 req-55d8eeda-5896-4056-8386-6aa7ab920ad6 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Processing event network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:50:59.020961 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:59.023914 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:59.032989 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:59.066733 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:50:59.573743 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442259.5730512, 49c705bc-074f-4fae-a607-2a8e0c33e066 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:50:59.574066 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] VM Started (Lifecycle Event)
Jun 26 02:50:59.575523 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:50:59.581028 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:50:59.584418 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance spawned successfully.
Jun 26 02:50:59.586699 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:50:59.769053 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.769589 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.769893 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.770193 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.770494 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.770730 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:50:59.770920 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:50:59.771146 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.57 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:51:00.078350 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:00.080066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:00.098262 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.098666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.099251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.099939 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.100406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.100960 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:00.583555 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:51:00.584079 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442260.5834332, 49c705bc-074f-4fae-a607-2a8e0c33e066 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:00.584079 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] VM Paused (Lifecycle Event)
Jun 26 02:51:00.613385 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Took 7.82 seconds to spawn the instance on the hypervisor.
Jun 26 02:51:00.613385 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:00.929552 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:00.929772 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:00.929957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:00.930077 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:00.930223 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] No waiting events found dispatching network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:00.930335 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-55fcd86b-11bb-478f-9cb7-ab5e81df8ca4 req-23989f39-9d36-4743-846f-4c39bb085fc5 service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received unexpected event network-vif-plugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 for instance with vm_state active and task_state None.
Jun 26 02:51:00.932882 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:00.999079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:00.999318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:00.999486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:00.999637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:00.999754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:01.005561 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Terminating instance
Jun 26 02:51:01.086208 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:01.088807 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442261.0885708, 49c705bc-074f-4fae-a607-2a8e0c33e066 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:01.088949 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] VM Resumed (Lifecycle Event)
Jun 26 02:51:01.123330 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Took 13.77 seconds to build instance.
Jun 26 02:51:01.509130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:01.548492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.550515 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.585177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.593519 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:01.598010 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:01.624183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.283s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:01.692977 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:01.701269 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:01.705006 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:01.705320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:01.707858 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] No waiting events found dispatching network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:01.710747 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e0d0a65f-093e-4974-824b-58ecd91edfe9 req-f2e11d6e-17b8-41a9-85d2-8854f9703ea9 service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:01.743650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.751051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.826361 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.838075 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:01.858332 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Instance destroyed successfully.
Jun 26 02:51:01.860390 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid 49030d5d-0dbf-4ed0-9593-60522ecb32f6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:01.863924 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed is timed out.
Jun 26 02:51:01.866219 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Found disk vdb by alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:51:01.866351 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Failed to detach device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2684}}
Jun 26 02:51:01.866843 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] (2/8): Attempting to detach device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <alias name="ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <serial>54b441cb-7c4b-4d93-9731-7cd9bdc79018</serial>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="fde1ad13-1b69-43a5-819d-7cd3cdb816ab"/>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:01.867179 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:51:02.058903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:02.100838 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999643365999873 future=<Future at 0x72e27c1e7590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:02.101178 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999184001999765 future=<Future at 0x72e27c1e7590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:02.101299 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999023753000074 future=<Future at 0x72e27c1e7590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:02.371173 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-946218523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-946218523',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:56Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-8klk3vwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:57Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=49030d5d-0dbf-4ed0-9593-60522ecb32f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:02.372495 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "37932b3e-c431-4b21-ace5-057910d8bd76", "address": "fa:16:3e:13:e1:16", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37932b3e-c4", "ovs_interfaceid": "37932b3e-c431-4b21-ace5-057910d8bd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:02.375733 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:02.376202 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:02.380987 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:02.381178 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37932b3e-c4, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:02.390025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:02.392459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:02.392459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1782f53-96a2-4ffd-93ef-59a74d0c5da2) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:02.394179 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:02.396039 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:02.398989 np0000003683 nova-compute[98991]: INFO os_vif [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e1:16,bridge_name='br-int',has_traffic_filtering=True,id=37932b3e-c431-4b21-ace5-057910d8bd76,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37932b3e-c4')
Jun 26 02:51:02.438730 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442262.4382923, 126a33da-d066-4fbf-bb4c-5da1f41252ed => ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:51:02.440348 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-54b441cb-7c4b-4d93-9731-7cd9bdc79018 for instance 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:51:02.442982 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully detached device vdb from instance 126a33da-d066-4fbf-bb4c-5da1f41252ed from the live domain config.
Jun 26 02:51:02.446169 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:02.446695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:02.446903 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:02.447609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:02.447934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54b441cb-7c4b-4d93-9731-7cd9bdc79018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:02.448142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:02.452087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:02.452303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:02.452512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.483349 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:02.484624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:02.485316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:02.486360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3cc0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:02.486646 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Removing multipathed devices sdm, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:02.486897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Flush multipath device 330000000844c6185 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:02.533386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:02.587119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:02.628858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if SCSI volumes sdm, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:02.629214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] SCSI volumes sdm, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:02.630948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Checking to see if device paths {'sdm', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:02.643540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Device paths {'sdm', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:02.643759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:02.655689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.694258 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260]
Jun 26 02:51:02.694258 np0000003683 nova-compute[98991]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:02.694258 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.717349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.729674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.769849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260]
Jun 26 02:51:02.769849 np0000003683 nova-compute[98991]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:02.769849 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.792415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:02.793436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:02.793599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] <== disconnect_volume: return (346ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:02.793881 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:02.795869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:02.796433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcdb2e89-1965-4d17-9c10-c1c41155586a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:02.796628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:02.833446 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:02.834021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:02.834021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '128')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:02.835387 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '127')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:02.836456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c31a480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'): ({'sdr'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:02.836949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Removing multipathed devices sdr, sds {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:02.837165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flush multipath device 33000000098a226c8 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:02.915154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:02.986217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:03.042970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:03.044182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:03.050961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:03.067788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:03.068023 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:03.081063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.121865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.40.100,3260]
Jun 26 02:51:03.121865 np0000003683 nova-compute[98991]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:03.121865 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.152049 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.167146 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.214858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.50.100,3260]
Jun 26 02:51:03.214858 np0000003683 nova-compute[98991]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:03.214858 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.244706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:03.244706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:03.244706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== disconnect_volume: return (791ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:03.244706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:03.245007 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Deleting instance files /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6_del
Jun 26 02:51:03.245472 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Deletion of /opt/stack/data/nova/instances/49030d5d-0dbf-4ed0-9593-60522ecb32f6_del complete
Jun 26 02:51:03.311872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:03.312315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:03.312660 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:03.312858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:03.313015 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:03.315356 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Terminating instance
Jun 26 02:51:03.353087 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'flavor' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:03.615211 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:03.615863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:03.751594 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Took 2.24 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:03.752400 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:03.754020 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:03.754020 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:03.754020 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:03.762214 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:03.765463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] Acquiring lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:03.765754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:03.765875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:03.766002 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] No waiting events found dispatching network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:03.766116 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c42240ef-3a9b-4910-aa87-35389d591894 req-68044462-437c-4216-8981-6189a88fcf3a service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-unplugged-37932b3e-c431-4b21-ace5-057910d8bd76 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:03.818501 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:03.850090 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.859911 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.882196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.882196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.910633 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.911066 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:03.929553 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:04.026905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:04.028067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:04.028067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:04.028067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:04.028067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] No waiting events found dispatching network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:04.028530 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37d0f4e7-e79c-429a-b190-6882bd317441 req-55aa17cd-86c8-4737-a75b-29bc9a39ca7f service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:04.118944 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Detaching volume e1d6f62f-72e0-42df-a20e-cf29b92618e0
Jun 26 02:51:04.187070 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Attempting to driver detach volume e1d6f62f-72e0-42df-a20e-cf29b92618e0 from mountpoint /dev/vdb
Jun 26 02:51:04.194494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found disk vdb by alias ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:51:04.198111 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found disk vdb by alias ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:51:04.198251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Attempting to detach device vdb from instance ed2fc500-5e0c-41d9-a529-cf132bff27be from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <alias name="ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0"/>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <serial>e1d6f62f-72e0-42df-a20e-cf29b92618e0</serial>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:04.198461 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:51:04.208241 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully detached device vdb from instance ed2fc500-5e0c-41d9-a529-cf132bff27be from the persistent domain config.
Jun 26 02:51:04.208364 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] (1/8): Attempting to detach device vdb with device alias ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0 from instance ed2fc500-5e0c-41d9-a529-cf132bff27be from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <alias name="ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0"/>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <serial>e1d6f62f-72e0-42df-a20e-cf29b92618e0</serial>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:04.208598 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:51:04.276255 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999749583999801 future=<Future at 0x72e29c65d0d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:04.281929 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Instance destroyed successfully.
Jun 26 02:51:04.282541 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lazy-loading 'resources' on Instance uuid 49c705bc-074f-4fae-a607-2a8e0c33e066 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:04.349210 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-089ca928-a374-45ca-a142-8597f9675b83 req-3822e2ea-8813-49e9-b9b6-a21012dfaffa service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Received event network-vif-deleted-37932b3e-c431-4b21-ace5-057910d8bd76 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:04.349465 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-089ca928-a374-45ca-a142-8597f9675b83 req-3822e2ea-8813-49e9-b9b6-a21012dfaffa service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Neutron deleted interface 37932b3e-c431-4b21-ace5-057910d8bd76; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:04.352795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-089ca928-a374-45ca-a142-8597f9675b83 req-3822e2ea-8813-49e9-b9b6-a21012dfaffa service nova] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Detach interface failed, port_id=37932b3e-c431-4b21-ace5-057910d8bd76, reason: Instance 49030d5d-0dbf-4ed0-9593-60522ecb32f6 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:04.359103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-323d6b49-8d90-4071-887f-4e5624fb002a tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:04.733467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:04.733923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:04.734074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:04.734286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:04.734452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:04.736719 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Terminating instance
Jun 26 02:51:04.765536 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442264.764513, ed2fc500-5e0c-41d9-a529-cf132bff27be => ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:51:04.765912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e1d6f62f-72e0-42df-a20e-cf29b92618e0 for instance ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:51:04.768403 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully detached device vdb from instance ed2fc500-5e0c-41d9-a529-cf132bff27be from the live domain config.
Jun 26 02:51:04.770127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:04.770468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:04.770620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:04.771051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:04.771262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1d6f62f-72e0-42df-a20e-cf29b92618e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:04.771369 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:04.781783 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:04.791043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-147715695',display_name='tempest-VolumesActionsTest-instance-147715695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-147715695',id=55,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:51:00Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-1xn7rnbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:51:01Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=49c705bc-074f-4fae-a607-2a8e0c33e066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:04.791286 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "address": "fa:16:3e:c1:ac:a1", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2752dbce-fa", "ovs_interfaceid": "2752dbce-fa25-4a75-a19d-8cecb30dab47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:04.791943 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:04.792180 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:04.793691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:04.793959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2752dbce-fa, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:04.795155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:04.796130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:04.798404 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:04.799362 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:04.799570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=181bceec-e540-4564-bd88-7e8edc649d95) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:04.801840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:04.802666 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:04.804556 np0000003683 nova-compute[98991]: INFO os_vif [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=2752dbce-fa25-4a75-a19d-8cecb30dab47,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2752dbce-fa')
Jun 26 02:51:04.804912 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Deleting instance files /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066_del
Jun 26 02:51:04.805630 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Deletion of /opt/stack/data/nova/instances/49c705bc-074f-4fae-a607-2a8e0c33e066_del complete
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:04.808212 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:04.808512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:04.808836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:04.809911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:04.810789 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3e6700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:04.810973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Removing multipathed devices sdd, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:04.811211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flush multipath device 330000000f4065274 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:04.859246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:04.916013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:04.953771 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking to see if SCSI volumes sdd, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:04.954085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] SCSI volumes sdd, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:04.956050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking to see if device paths {'sdd', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:04.967635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Device paths {'sdd', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:04.967873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:04.982868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.024647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.40.100,3260]
Jun 26 02:51:05.024647 np0000003683 nova-compute[98991]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:05.024647 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.043970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.054698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.094704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.50.100,3260]
Jun 26 02:51:05.094704 np0000003683 nova-compute[98991]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:05.094704 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.117338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:05.117616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:05.117751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== disconnect_volume: return (347ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:05.117897 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:05.240066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:05.268523 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.274193 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.285144 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Took 1.53 seconds to deallocate network for instance.
Jun 26 02:51:05.295610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.298606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.314029 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Took 1.50 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:05.314652 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:05.314985 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:05.315079 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:05.315382 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:05.331892 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.495757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:05.495927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:05.497127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:05.497345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:05.497554 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:05.500348 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:05.502223 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b68b31cb-0476-4592-a937-198801ccfeba req-4e86a0e1-d4b6-4076-9d6f-f667d6063c0d service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:05.558777 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.568838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:05.589442 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998788285000046 future=<Future at 0x72e27c269b80 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:05.591330 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Instance destroyed successfully.
Jun 26 02:51:05.591783 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lazy-loading 'resources' on Instance uuid 126a33da-d066-4fbf-bb4c-5da1f41252ed {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:05.675287 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:05.868454 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Took 0.58 seconds to detach 1 volumes for instance.
Jun 26 02:51:06.096268 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-388591585',display_name='tempest-TestEncryptedCinderVolumes-server-388591585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-388591585',id=48,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VzkVqk3pvqpPot8VDUktZx/vytXnv31UGnxoziZTyUi2sV60omKvVwWWWenOD0X2fc5ryzfPH6B2/sjpF+GHb0tgvD9LJBRHVvuQSwA0bA59xF+Xm/rv9P6aCyAON2g==',key_name='tempest-keypair-1051777278',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:33Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='419e029cdd744c1598f7a9d2bcc52340',ramdisk_id='',reservation_id='r-qsv26n32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1629371133',owner_user_name='tempest-TestEncryptedCinderVolumes-1629371133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13af0bfb96bf40179144f66af7baeed9',uuid=126a33da-d066-4fbf-bb4c-5da1f41252ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:06.096508 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converting VIF {"id": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "address": "fa:16:3e:1a:81:38", "network": {"id": "6bd12262-1c9e-40ac-aa62-5ed0314afba8", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-932478435-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "419e029cdd744c1598f7a9d2bcc52340", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1c496-63", "ovs_interfaceid": "0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:06.098148 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:06.098148 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:06.099265 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:06.099406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] Acquiring lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:06.099558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:06.099657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:06.099761 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] No waiting events found dispatching network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:06.099865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-unplugged-2752dbce-fa25-4a75-a19d-8cecb30dab47 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:06.099962 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Received event network-vif-deleted-2752dbce-fa25-4a75-a19d-8cecb30dab47 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:06.100095 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Neutron deleted interface 2752dbce-fa25-4a75-a19d-8cecb30dab47; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:06.100578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:06.100778 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cc1c496-63, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:06.101789 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f370b7e3-2dcd-4dd5-9142-280b1e6d89fa req-5fef5a8d-49b3-4fbd-b883-6ca69a42736d service nova] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Detach interface failed, port_id=2752dbce-fa25-4a75-a19d-8cecb30dab47, reason: Instance 49c705bc-074f-4fae-a607-2a8e0c33e066 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:06.102772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:06.103531 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:06.105016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:06.105815 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:06.105947 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=974b8f23-5b46-4786-90fd-eb71a8b0c129) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:06.106385 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:06.108353 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:06.110088 np0000003683 nova-compute[98991]: INFO os_vif [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:81:38,bridge_name='br-int',has_traffic_filtering=True,id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b,network=Network(6bd12262-1c9e-40ac-aa62-5ed0314afba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1c496-63')
Jun 26 02:51:06.110547 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Deleting instance files /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_del
Jun 26 02:51:06.117034 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Deletion of /opt/stack/data/nova/instances/126a33da-d066-4fbf-bb4c-5da1f41252ed_del complete
Jun 26 02:51:06.235938 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:06.386614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:06.387751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:06.625335 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:06.625943 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:06.626175 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:06.626318 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:06.626589 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:06.681373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9acd7fc3-7a2a-4914-8a55-be5b5d2bbfd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.066s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:06.737884 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Took 1.42 seconds to deallocate network for instance.
Jun 26 02:51:06.750784 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:06.879830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:06.880387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:06.880387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:06.880387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:06.880552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:06.883405 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Terminating instance
Jun 26 02:51:07.063099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.249790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:07.288889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:07.289172 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:07.390600 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:07.414106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.431129 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.442486 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.444213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.475804 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:07.573569 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] Acquiring lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] No waiting events found dispatching network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-unplugged-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:07.574769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Received event network-vif-deleted-0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:07.575273 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Neutron deleted interface 0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:07.578917 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffa83b2d-ce0c-4e71-b83d-0194e7489fd3 req-69c2c5c3-ee0a-46b1-acca-8b5021ce5949 service nova] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Detach interface failed, port_id=0cc1c496-6367-4fe9-84cd-4a2eaf4c9e3b, reason: Instance 126a33da-d066-4fbf-bb4c-5da1f41252ed could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:07.718658 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:07.751098 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999728975999915 future=<Future at 0x72e29c247e60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:07.753468 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Instance destroyed successfully.
Jun 26 02:51:07.756591 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'resources' on Instance uuid ed2fc500-5e0c-41d9-a529-cf132bff27be {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:07.792219 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:08.160427 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:08.160918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:08.160918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:08.160918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:08.161063 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] No waiting events found dispatching network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:08.161063 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:08.161165 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:08.161283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Acquiring lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:08.161387 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:08.161492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:08.161608 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] No waiting events found dispatching network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:08.161703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c7aebf69-30ba-4cab-947a-c0e6c8b28cdd req-c2501c80-e8af-412a-b9a2-171f21521c6a service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-unplugged-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:08.222972 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Took 1.60 seconds to deallocate network for instance.
Jun 26 02:51:08.259243 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2052843186',display_name='tempest-VolumesBackupsTest-instance-2052843186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-2052843186',id=50,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQgEkkSSIz+wfs79yKdc02CqAztM2kfsGGO2GWOhG6v7AHEf5sNxW/rYcaiZt3Nb488QWnRokYEBYx+zpVNx1zXoLvngalRuMsKNGt/oUS49CZspXKRcY3o3rNpz0E59g==',key_name='tempest-keypair-70909028',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:49:55Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-0k0isqpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=ed2fc500-5e0c-41d9-a529-cf132bff27be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:08.259515 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "address": "fa:16:3e:b5:b1:0f", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap908a9f0e-f6", "ovs_interfaceid": "908a9f0e-f6dd-4b04-a7d1-909a1f375d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:08.261080 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:08.261080 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:08.262256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.262446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908a9f0e-f6, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:08.263597 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.264332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:08.264689 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.265446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.265624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6371eb50-d0d4-47da-8d18-074eab2d9aa9) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:08.266054 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.266632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:08.266767 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:08.268452 np0000003683 nova-compute[98991]: INFO os_vif [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:0f,bridge_name='br-int',has_traffic_filtering=True,id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908a9f0e-f6')
Jun 26 02:51:08.268963 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Deleting instance files /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be_del
Jun 26 02:51:08.269822 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Deletion of /opt/stack/data/nova/instances/ed2fc500-5e0c-41d9-a529-cf132bff27be_del complete
Jun 26 02:51:08.298589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.911s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:08.300115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.049s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:08.372764 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance 49030d5d-0dbf-4ed0-9593-60522ecb32f6
Jun 26 02:51:08.727402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:08.778050 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:08.778519 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:08.778751 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:08.778812 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:08.779001 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:08.910942 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:08.989996 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:08.990331 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:09.380917 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-041e2216-d65c-4286-a09a-c01acc902eb0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "49030d5d-0dbf-4ed0-9593-60522ecb32f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.382s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:09.493099 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:09.629763 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a9f63c1-dd56-4e29-8198-41f9742ced9c req-109d43c3-29c9-472e-9a8f-291b19fef2b1 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Received event network-vif-deleted-908a9f0e-f6dd-4b04-a7d1-909a1f375d54 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:09.630136 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-1a9f63c1-dd56-4e29-8198-41f9742ced9c req-109d43c3-29c9-472e-9a8f-291b19fef2b1 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Neutron deleted interface 908a9f0e-f6dd-4b04-a7d1-909a1f375d54; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:09.631718 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a9f63c1-dd56-4e29-8198-41f9742ced9c req-109d43c3-29c9-472e-9a8f-291b19fef2b1 service nova] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Detach interface failed, port_id=908a9f0e-f6dd-4b04-a7d1-909a1f375d54, reason: Instance ed2fc500-5e0c-41d9-a529-cf132bff27be could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:09.890575 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:09.999299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.700s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:10.001033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.274s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:10.076142 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Deleted allocations for instance 49c705bc-074f-4fae-a607-2a8e0c33e066
Jun 26 02:51:10.392393 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Took 1.61 seconds to deallocate network for instance.
Jun 26 02:51:10.684297 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:10.684559 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:10.900588 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:11.089501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d00c94a-3072-4a1b-8aee-a650a8b3ab2e tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "49c705bc-074f-4fae-a607-2a8e0c33e066" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.775s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:11.187032 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:11.694992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.694s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:11.697139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.795s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:11.776240 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Deleted allocations for instance 126a33da-d066-4fbf-bb4c-5da1f41252ed
Jun 26 02:51:12.065611 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.132342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:12.132587 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:12.132743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:12.132909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:12.133041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:12.135136 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Terminating instance
Jun 26 02:51:12.391501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:12.391825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:12.408782 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:12.408949 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:12.650747 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:12.685216 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.688372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.715165 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.775242 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.788899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d7fd9b5f-9332-4a6c-97d9-a1039544f39b tempest-TestEncryptedCinderVolumes-1629371133 tempest-TestEncryptedCinderVolumes-1629371133-project-member] Lock "126a33da-d066-4fbf-bb4c-5da1f41252ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.055s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:12.858964 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.866103 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:12.880686 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:12.881174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:12.881402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:12.881592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:12.881769 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:12.881967 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6ef1b9c5-d795-4496-a522-d7e4072776f6 req-bdd22ca8-cfd6-4b2c-b061-f9cb011cfdc1 service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:12.893390 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:51:12.911983 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:12.987151 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999707255999965 future=<Future at 0x72e27c4de6c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:12.989935 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Instance destroyed successfully.
Jun 26 02:51:12.990771 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid f0c513bb-680e-44fa-a657-c22de6578b1b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:13.266872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.420899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.726s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:13.443207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:13.443379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:13.447060 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:51:13.447254 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Claim successful on node np0000003683
Jun 26 02:51:13.472773 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Deleted allocations for instance ed2fc500-5e0c-41d9-a529-cf132bff27be
Jun 26 02:51:13.493263 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=45,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:49:54Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-iez6duzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=f0c513bb-680e-44fa-a657-c22de6578b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:13.493502 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "e090a292-3a46-4777-8978-eb75d9b4e5df", "address": "fa:16:3e:18:02:69", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape090a292-3a", "ovs_interfaceid": "e090a292-3a46-4777-8978-eb75d9b4e5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:13.493938 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:13.494160 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:13.495071 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.495309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape090a292-3a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:13.496318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.497339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:13.497685 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.498415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.498565 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=217812c3-4c7a-4717-9124-833acf26babc) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:13.499011 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.499686 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:13.499946 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:13.501796 np0000003683 nova-compute[98991]: INFO os_vif [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:02:69,bridge_name='br-int',has_traffic_filtering=True,id=e090a292-3a46-4777-8978-eb75d9b4e5df,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape090a292-3a')
Jun 26 02:51:13.502114 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Deleting instance files /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_del
Jun 26 02:51:13.511084 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Deletion of /opt/stack/data/nova/instances/f0c513bb-680e-44fa-a657-c22de6578b1b_del complete
Jun 26 02:51:14.017235 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:14.017726 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:14.017956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:14.018034 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:14.018218 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:14.072462 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:14.481634 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-61e838bc-b012-4d76-a724-e23330cd4c23 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "ed2fc500-5e0c-41d9-a529-cf132bff27be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.601s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:14.950609 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:14.950806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] Acquiring lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:14.951224 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:14.951323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:14.951439 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] No waiting events found dispatching network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:14.951622 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-unplugged-e090a292-3a46-4777-8978-eb75d9b4e5df for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:14.952140 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Received event network-vif-deleted-e090a292-3a46-4777-8978-eb75d9b4e5df {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:14.952140 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Neutron deleted interface e090a292-3a46-4777-8978-eb75d9b4e5df; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:14.953572 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-18428af1-67ca-460e-9e59-d30ac72285d0 req-21a4b443-ab2d-424f-ba26-04b0cc1e070e service nova] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Detach interface failed, port_id=e090a292-3a46-4777-8978-eb75d9b4e5df, reason: Instance f0c513bb-680e-44fa-a657-c22de6578b1b could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:15.004860 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:15.028822 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:15.029261 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:15.506869 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Took 1.49 seconds to deallocate network for instance.
Jun 26 02:51:15.532074 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:16.012806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:16.039157 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.596s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:16.039635 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:51:16.040811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.028s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:16.050087 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.123258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:16.123535 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:16.123712 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:16.123879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:16.124015 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:16.126075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Terminating instance
Jun 26 02:51:16.545024 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:51:16.545311 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:51:16.545673 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:16.546020 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:16.629237 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:16.657412 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.660209 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2e15651c2d142d9838bb7a85863b775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91d5830f544432d89b9c8613c0a99c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:51:16.678829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.681391 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:16.681651 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:16.690352 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.717910 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.724118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:16.992510 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999757177999982 future=<Future at 0x72e29e76e930 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:16.993949 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Instance destroyed successfully.
Jun 26 02:51:16.994627 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lazy-loading 'resources' on Instance uuid 173e3dc3-be91-41bc-b353-ecac928a7c90 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:17.032146 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:17.033919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:17.034158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:17.034955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:17.034955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] No waiting events found dispatching network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:17.034955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:17.034955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:17.034955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Acquiring lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:17.035320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:17.035320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:17.035320 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] No waiting events found dispatching network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:17.035428 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0022718-4be5-4834-9e93-ed196b29172c req-50196fed-7472-4964-894f-1924e1c38351 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-unplugged-c2f40694-6df1-42ed-87e8-dbf564e1b93e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:17.051512 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:51:17.067152 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.104518 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.004064543999902526 future=<Future at 0x72e27c1e7590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:17.104518 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:17.105740 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.171222686999954 future=<Future at 0x72e29c65d0d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:17.105740 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.171156283000073 future=<Future at 0x72e29c65d0d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:17.105740 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442262.1002626, 49030d5d-0dbf-4ed0-9593-60522ecb32f6 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:17.106753 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] VM Stopped (Lifecycle Event)
Jun 26 02:51:17.184210 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:17.229433 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Successfully created port: 47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:51:17.499124 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-82425095',display_name='tempest-instance-82425095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-instance-82425095',id=51,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJJL90802W01rdKiBGumzKL49Bluvhm37UOGv5Q5xLi/mqbwWB18no25wTut6XBbW1xQCH2iw53Cbk6p9oX6a17n4v9GXO5oRhl3MHUTr+cUXt7ja/1u7GXMy0bDlgWDQ==',key_name='tempest-keypair-179190207',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:37Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a0a7fdd73fc40328c4c73ef53edc697',ramdisk_id='',reservation_id='r-mofewi97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-232973889',owner_user_name='tempest-VolumesBackupsTest-232973889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abcc90720de4d3e8d49aa5c4bb02b11',uuid=173e3dc3-be91-41bc-b353-ecac928a7c90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:17.499124 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converting VIF {"id": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "address": "fa:16:3e:f8:d9:e0", "network": {"id": "c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-495504545-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a0a7fdd73fc40328c4c73ef53edc697", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f40694-6d", "ovs_interfaceid": "c2f40694-6df1-42ed-87e8-dbf564e1b93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:17.499124 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:17.499124 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:17.500665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.500665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2f40694-6d, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:17.501667 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.502070 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:17.502556 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.503420 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.503420 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5133889-fdb7-472c-9efd-c2a4c91e95e3) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:17.503939 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.504305 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:17.504727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:17.506974 np0000003683 nova-compute[98991]: INFO os_vif [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d9:e0,bridge_name='br-int',has_traffic_filtering=True,id=c2f40694-6df1-42ed-87e8-dbf564e1b93e,network=Network(c82f4e14-f9ed-41ff-989b-f6e7d5cf00a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f40694-6d')
Jun 26 02:51:17.508508 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:17.509100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:17.509259 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:17.554885 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:51:17.570141 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.061s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:17.570612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:17.570753 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:17.606083 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:17.606377 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:17.606638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:17.606638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:17.607879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:17.609121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c57b7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:17.609302 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Removing multipathed devices sdj, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:17.609944 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Flush multipath device 330000000c7f4e315 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:17.612423 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 49030d5d-0dbf-4ed0-9593-60522ecb32f6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:17.664879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:17.692837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.652s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:17.715687 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Successfully updated port: 47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:51:17.717508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:17.757397 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance f0c513bb-680e-44fa-a657-c22de6578b1b
Jun 26 02:51:17.768826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Checking to see if SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:17.769005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] SCSI volumes sdj, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:17.770268 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Checking to see if device paths {'sdj', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:17.782404 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Device paths {'sdj', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:17.782592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:17.795829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.830587 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260]
Jun 26 02:51:17.830587 np0000003683 nova-compute[98991]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:17.830587 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.859171 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.876893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.921084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.50.100,3260]
Jun 26 02:51:17.921084 np0000003683 nova-compute[98991]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:17.921084 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.940816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:17.941029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:17.941148 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] <== disconnect_volume: return (431ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:17.941294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:17.941523 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Deleting instance files /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90_del
Jun 26 02:51:17.942094 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Deletion of /opt/stack/data/nova/instances/173e3dc3-be91-41bc-b353-ecac928a7c90_del complete
Jun 26 02:51:18.001202 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:18.217806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:51:18.218284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquired lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:51:18.218284 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:51:18.448830 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Took 1.82 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:18.449890 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:18.450075 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:18.450169 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:18.450430 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:18.562146 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:51:18.563265 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:51:18.563579 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Creating image(s)
Jun 26 02:51:18.564090 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:18.564281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:18.564792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:18.565446 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:18.569158 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:18.570760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:18.602360 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:18.683673 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:18.684281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:18.684839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:18.685522 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:18.694026 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:18.694561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:18.771283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14f8f746-fd88-40bf-b584-9369ff73afdc tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "f0c513bb-680e-44fa-a657-c22de6578b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.638s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:18.811192 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:18.811682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:18.847856 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:51:18.881014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk 1073741824" returned: 0 in 0.069s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:18.881014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:18.881263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:18.999763 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.118s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:19.000304 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:51:19.000583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:19.086216 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:19.111821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:19.111956 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Cannot resize image /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:51:19.112345 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:51:19.112546 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Ensure instance console log exists: /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:51:19.112813 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:19.113037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:19.113235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:19.127342 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-changed-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:19.127595 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Refreshing instance network info cache due to event network-changed-47607ed3-b77c-46aa-b6e8-f95842f5631e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:51:19.127872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] Acquiring lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:51:19.272426 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Updating instance_info_cache with network_info: [{"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:19.276512 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005722159999095311 future=<Future at 0x72e29c65d0d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:19.277006 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Emitting event <LifecycleEvent: 1782442264.2757847, 49c705bc-074f-4fae-a607-2a8e0c33e066 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:19.277499 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:19.277599 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] VM Stopped (Lifecycle Event)
Jun 26 02:51:19.279152 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.3098459510001703 future=<Future at 0x72e27c269b80 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:19.279152 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.309202773999914 future=<Future at 0x72e27c269b80 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:19.364491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:19.364682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:19.364918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:19.365082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:19.365219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:19.367847 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Terminating instance
Jun 26 02:51:19.709909 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:19.774553 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Releasing lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:51:19.774861 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Instance network_info: |[{"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:51:19.777294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Start _get_guest_xml network_info=[{"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:51:19.777850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] Acquired lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:51:19.778073 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Refreshing network info cache for port 47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:51:19.780754 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 49c705bc-074f-4fae-a607-2a8e0c33e066] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:19.784821 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:51:19.786370 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-138000110', uuid='f94f2230-b9aa-43cd-b423-e86e58e7bb42'), owner=OwnerMeta(userid='d2e15651c2d142d9838bb7a85863b775', username='tempest-VolumesActionsTest-1779422939-project-member', projectid='b91d5830f544432d89b9c8613c0a99c6', projectname='tempest-VolumesActionsTest-1779422939'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442279.7859) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:51:19.789188 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:51:19.790081 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:51:19.791953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:51:19.792713 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:51:19.793988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:51:19.794625 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:51:19.794855 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:51:19.795010 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:51:19.795203 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:51:19.795326 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:51:19.795466 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:51:19.795708 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:51:19.795870 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:51:19.796057 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:51:19.796233 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:51:19.796432 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:51:19.808187 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138000110',display_name='tempest-VolumesActionsTest-instance-138000110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-138000110',id=56,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-sr0sklw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:51:18Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=f94f2230-b9aa-43cd-b423-e86e58e7bb42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:51:19.808511 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:19.809016 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:19.809719 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lazy-loading 'pci_devices' on Instance uuid f94f2230-b9aa-43cd-b423-e86e58e7bb42 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:19.872054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:19.909366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:19.914460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:19.944576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.174329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.180529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.197680 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:20.199138 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:20.199419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:20.199645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:20.199946 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:20.200090 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5efa3056-f7e0-4922-a77f-4cc8d729b426 req-b18ba0a6-a4f3-4bc1-945c-6451dca00935 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:20.212450 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Took 1.76 seconds to deallocate network for instance.
Jun 26 02:51:20.255523 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998510959000214 future=<Future at 0x72e29c4be3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:20.260072 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Instance destroyed successfully.
Jun 26 02:51:20.260072 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:20.280491 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <uuid>f94f2230-b9aa-43cd-b423-e86e58e7bb42</uuid>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <name>instance-00000038</name>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesActionsTest-instance-138000110</nova:name>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:51:19</nova:creationTime>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:user uuid="d2e15651c2d142d9838bb7a85863b775">tempest-VolumesActionsTest-1779422939-project-member</nova:user>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:project uuid="b91d5830f544432d89b9c8613c0a99c6">tempest-VolumesActionsTest-1779422939</nova:project>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         <nova:port uuid="47607ed3-b77c-46aa-b6e8-f95842f5631e">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="serial">f94f2230-b9aa-43cd-b423-e86e58e7bb42</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="uuid">f94f2230-b9aa-43cd-b423-e86e58e7bb42</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.config"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b2:e4:92"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <target dev="tap47607ed3-b7"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/console.log" append="off"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:51:20.313078 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Preparing to wait for external event network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138000110',display_name='tempest-VolumesActionsTest-instance-138000110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-138000110',id=56,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-sr0sklw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:51:18Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=f94f2230-b9aa-43cd-b423-e86e58e7bb42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:51:20.315281 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:20.315612 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:20.315813 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:51:20.317240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.317641 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.317890 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:51:20.319313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.319751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31549032-a541-5aad-866a-7ba68bbd212c', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.321390 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:20.328907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.334931 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.335236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47607ed3-b7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.335698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47607ed3-b7, col_values=(('qos', UUID('2b2b9b9c-5d86-4e24-98e6-d79cc7ddeea0')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.335926 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47607ed3-b7, col_values=(('external_ids', {'iface-id': '47607ed3-b77c-46aa-b6e8-f95842f5631e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e4:92', 'vm-uuid': 'f94f2230-b9aa-43cd-b423-e86e58e7bb42'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.337275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.338608 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:20.350975 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.352333 np0000003683 nova-compute[98991]: INFO os_vif [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7')
Jun 26 02:51:20.588648 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00040824500001690467 future=<Future at 0x72e27c269b80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:20.588830 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:20.588830 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.1590370339999936 future=<Future at 0x72e29c247e60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:20.588921 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.1589356350000344 future=<Future at 0x72e29c247e60 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:20.589311 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442265.5881424, 126a33da-d066-4fbf-bb4c-5da1f41252ed => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:20.589434 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] VM Stopped (Lifecycle Event)
Jun 26 02:51:20.643044 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:20.765045 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=43,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:49:00Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-0j0r3mgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=2f7efbb6-021e-4bc3-a514-f21f96d3ff29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:20.765308 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "address": "fa:16:3e:a6:ed:f4", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7cfe23d-16", "ovs_interfaceid": "c7cfe23d-16e2-4912-8b79-2d44cb60e8c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:20.765896 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:20.766240 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:20.767823 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.768092 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7cfe23d-16, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.769306 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.770542 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:20.775794 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 02:51:20.777139 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.778331 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.778658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d5c027e-0e77-482e-b4e5-7564f4dd242a) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:20.781189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.782864 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:20.786382 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:20.788674 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Updated VIF entry in instance network info cache for port 47607ed3-b77c-46aa-b6e8-f95842f5631e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:51:20.788971 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Updating instance_info_cache with network_info: [{"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:20.791304 np0000003683 nova-compute[98991]: INFO os_vif [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ed:f4,bridge_name='br-int',has_traffic_filtering=True,id=c7cfe23d-16e2-4912-8b79-2d44cb60e8c5,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7cfe23d-16')
Jun 26 02:51:20.791688 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Deleting instance files /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_del
Jun 26 02:51:20.800329 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Deletion of /opt/stack/data/nova/instances/2f7efbb6-021e-4bc3-a514-f21f96d3ff29_del complete
Jun 26 02:51:21.092902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0f222afd-4d7b-42e9-858d-72c204cfc80c tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 126a33da-d066-4fbf-bb4c-5da1f41252ed] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:21.194696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e1f1470-1e3d-4258-aa0a-76e55fce1827 req-8a9b4af5-ebf0-4af1-b97c-c0cf1fec9842 service nova] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Received event network-vif-deleted-c2f40694-6df1-42ed-87e8-dbf564e1b93e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:21.284382 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:21.284922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:21.295867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4db1d622-ae92-42b5-9160-8b29b02c0be3 req-0e0389c3-fe92-422a-aa02-ab86f88cf19f service nova] Releasing lock "refresh_cache-f94f2230-b9aa-43cd-b423-e86e58e7bb42" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:51:21.314608 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:21.315922 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:21.317900 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:21.319274 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:21.320727 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:21.398635 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:21.632959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:21.633307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:21.633595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:21.633719 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:21.633857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:21.636883 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Terminating instance
Jun 26 02:51:21.878021 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:21.878134 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:21.878455 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] No VIF found with MAC fa:16:3e:b2:e4:92, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:51:21.879370 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Using config drive
Jun 26 02:51:21.954201 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:21.954605 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:22.078115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.140061 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:22.181398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.182013 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.217132 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.239835 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:22.282737 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:22.282923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] Acquiring lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:22.283114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:22.283263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:22.283424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] No waiting events found dispatching network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:22.283581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a46d435c-8425-4614-844c-1d0a7a7dacef req-92c3c7e5-8763-403f-929c-db4ef359f410 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-unplugged-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:22.351114 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.363072 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:22.384104 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:22.457265 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:22.510773 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999752559999706 future=<Future at 0x72e27c4aa600 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:22.514577 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Instance destroyed successfully.
Jun 26 02:51:22.515104 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'resources' on Instance uuid 635540bc-bb17-41d4-82c3-39b742a7f65e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:22.540278 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Creating config drive at /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.config
Jun 26 02:51:22.544735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx90o6ip6 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:22.600818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx90o6ip6" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:22.743407 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Took 1.42 seconds to deallocate network for instance.
Jun 26 02:51:22.752314 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0037010220003139693 future=<Future at 0x72e29c247e60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:22.752314 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:22.752314 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.23486469799991 future=<Future at 0x72e27c4de6c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:22.752314 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.234771994999846 future=<Future at 0x72e27c4de6c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:22.753070 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Emitting event <LifecycleEvent: 1782442267.7478123, ed2fc500-5e0c-41d9-a529-cf132bff27be => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:22.753290 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] VM Stopped (Lifecycle Event)
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.688s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-854453160',display_name='tempest-TestVolumeBootPatternV346-server-854453160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-854453160',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxt8CD6/IF9NEJb7WP0NQapMA8KzgIfAAhL7RBR6gNhX5hcO3Pa0PABnlU1vfXIFrnMdXU/ctqAdPVBKx6XRLBDjMe+neJzBZC5KThwVVz5O9N6kd4LpWE57mM07ivQ7A==',key_name='tempest-keypair-12928320',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:43Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-rsusg69h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=635540bc-bb17-41d4-82c3-39b742a7f65e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "466b9e64-ee02-48ce-8d31-3c994089d383", "address": "fa:16:3e:1f:2c:fe", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap466b9e64-ee", "ovs_interfaceid": "466b9e64-ee02-48ce-8d31-3c994089d383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap466b9e64-ee, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5da0e160-4fcc-4c47-9a44-e80d48eafcc5) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: INFO os_vif [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=466b9e64-ee02-48ce-8d31-3c994089d383,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap466b9e64-ee')
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Deleted allocations for instance 173e3dc3-be91-41bc-b353-ecac928a7c90
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:23.517121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: ed2fc500-5e0c-41d9-a529-cf132bff27be] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Received event network-vif-deleted-c7cfe23d-16e2-4912-8b79-2d44cb60e8c5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] No waiting events found dispatching network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Acquiring lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] No waiting events found dispatching network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:23.520507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b83c4b2f-16af-443b-b7fa-1bfe9dac1c07 req-24c35d16-c893-47a0-a421-b34e55e7cad4 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-unplugged-466b9e64-ee02-48ce-8d31-3c994089d383 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:23.793269 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:23.793605 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:23.996841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:23.996841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:24.001149 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:24.037131 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:24.038907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:24.078291 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442284.0777564, f94f2230-b9aa-43cd-b423-e86e58e7bb42 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:24.078415 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] VM Started (Lifecycle Event)
Jun 26 02:51:24.102265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb22d403-0eba-450a-85c6-2c3a8a51485a tempest-VolumesBackupsTest-232973889 tempest-VolumesBackupsTest-232973889-project-member] Lock "173e3dc3-be91-41bc-b353-ecac928a7c90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.979s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:24.206286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.157s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:24.206908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:24.207237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:24.239683 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:24.239950 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:24.240139 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:24.240233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:24.241919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:24.242580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4d11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'): ({'sdp'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:24.242813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Removing multipathed devices sdo, sdp {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:24.243080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flush multipath device 33000000057f587a9 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:24.299942 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:24.314383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:24.356821 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fa0cddae-3ecc-489e-b3f7-eab256e4f76b req-43020f93-d170-4ee1-a644-8697706897e5 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:24.357017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa0cddae-3ecc-489e-b3f7-eab256e4f76b req-43020f93-d170-4ee1-a644-8697706897e5 service nova] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:24.357167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa0cddae-3ecc-489e-b3f7-eab256e4f76b req-43020f93-d170-4ee1-a644-8697706897e5 service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:24.357325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa0cddae-3ecc-489e-b3f7-eab256e4f76b req-43020f93-d170-4ee1-a644-8697706897e5 service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:24.357444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fa0cddae-3ecc-489e-b3f7-eab256e4f76b req-43020f93-d170-4ee1-a644-8697706897e5 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Processing event network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:51:24.358426 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:51:24.363169 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:51:24.364988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:24.367967 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Instance spawned successfully.
Jun 26 02:51:24.368466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:51:24.429887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if SCSI volumes sdo, sdp have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:24.430383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] SCSI volumes sdo, sdp have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:24.432031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if device paths {'sdo', 'sdp'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:24.445993 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Device paths {'sdo', 'sdp'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:24.446266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:24.460498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.497086 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.40.100,3260]
Jun 26 02:51:24.497086 np0000003683 nova-compute[98991]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:24.497086 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.520669 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.544699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.581574 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:24.585999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.50.100,3260]
Jun 26 02:51:24.585999 np0000003683 nova-compute[98991]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:24.585999 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.585999 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:24.606244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:24.606516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:24.606692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== disconnect_volume: return (1557ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:24.606830 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:24.607125 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Deleting instance files /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e_del
Jun 26 02:51:24.607719 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Deletion of /opt/stack/data/nova/instances/635540bc-bb17-41d4-82c3-39b742a7f65e_del complete
Jun 26 02:51:24.807340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.552s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:24.876987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.877756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.878851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.880674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.882704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.882704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:24.889987 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance 2f7efbb6-021e-4bc3-a514-f21f96d3ff29
Jun 26 02:51:24.894761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:25.091490 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:51:25.093678 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442285.091608, f94f2230-b9aa-43cd-b423-e86e58e7bb42 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:25.093678 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] VM Paused (Lifecycle Event)
Jun 26 02:51:25.114783 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Took 2.97 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:25.115049 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:25.115274 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:25.115371 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:25.115653 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:25.230196 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:25.389981 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Took 6.83 seconds to spawn the instance on the hypervisor.
Jun 26 02:51:25.390130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:25.598428 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:25.603005 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442285.601414, f94f2230-b9aa-43cd-b423-e86e58e7bb42 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:25.603005 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] VM Resumed (Lifecycle Event)
Jun 26 02:51:25.735828 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93d500a7-fe98-4dce-87d1-8b8569d72553 req-53d6dc5c-0723-47e9-997e-2dbd17d2d7c8 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Received event network-vif-deleted-466b9e64-ee02-48ce-8d31-3c994089d383 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:25.735965 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-93d500a7-fe98-4dce-87d1-8b8569d72553 req-53d6dc5c-0723-47e9-997e-2dbd17d2d7c8 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Neutron deleted interface 466b9e64-ee02-48ce-8d31-3c994089d383; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:25.737943 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-93d500a7-fe98-4dce-87d1-8b8569d72553 req-53d6dc5c-0723-47e9-997e-2dbd17d2d7c8 service nova] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Detach interface failed, port_id=466b9e64-ee02-48ce-8d31-3c994089d383, reason: Instance 635540bc-bb17-41d4-82c3-39b742a7f65e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:25.902208 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-98dd7d27-f5bb-4c4f-b331-e9f23a45738d tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "2f7efbb6-021e-4bc3-a514-f21f96d3ff29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.537s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:25.908208 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Took 12.51 seconds to build instance.
Jun 26 02:51:26.106077 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:26.113504 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:26.177167 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:26.409930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.018s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:26.431600 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:26.431836 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:26.432068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:26.433058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:26.433265 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] No waiting events found dispatching network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:26.433458 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-596c3b8e-9a08-4696-84ad-daed9173da85 req-acbb9b62-93f4-4909-b7b5-e1dfee9271ca service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received unexpected event network-vif-plugged-47607ed3-b77c-46aa-b6e8-f95842f5631e for instance with vm_state active and task_state None.
Jun 26 02:51:26.681543 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Took 1.56 seconds to deallocate network for instance.
Jun 26 02:51:27.080545 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:27.271926 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Took 0.59 seconds to detach 1 volumes for instance.
Jun 26 02:51:27.782033 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:27.782413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:27.839113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:27.839305 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:27.839488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:27.839608 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:27.839706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:27.842285 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Terminating instance
Jun 26 02:51:27.987119 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00032498400014446815 future=<Future at 0x72e27c4de6c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:27.988710 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Emitting event <LifecycleEvent: 1782442272.986705, f0c513bb-680e-44fa-a657-c22de6578b1b => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:27.989621 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] VM Stopped (Lifecycle Event)
Jun 26 02:51:27.990450 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:27.990450 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.001972351000404 future=<Future at 0x72e29e76e930 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:27.990450 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.001808225000332 future=<Future at 0x72e29e76e930 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:28.040524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.210052 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:28.210286 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:28.346112 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:28.416882 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.418825 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.423278 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.436740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:28.436903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:28.437051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:28.437207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:28.437337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:28.442069 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Terminating instance
Jun 26 02:51:28.447222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.491540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2bdc3b1e-b69b-4850-8f8d-6c3017265a2b tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: f0c513bb-680e-44fa-a657-c22de6578b1b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:28.571711 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.577766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.650628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.659147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.674684 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999684042000354 future=<Future at 0x72e27c2a90d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:28.677217 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Instance destroyed successfully.
Jun 26 02:51:28.678608 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid 438d9a42-bd81-4489-8c87-68f146dfc61b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:28.713239 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:28.946792 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:28.974774 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.978537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:28.998282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.012308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.042110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.052853 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.182042 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-1',id=40,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:47:02Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-vyaxwdko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=438d9a42-bd81-4489-8c87-68f146dfc61b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:29.182402 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "cb535a56-d9b1-4193-bbaf-14a54d385198", "address": "fa:16:3e:2f:6b:c0", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535a56-d9", "ovs_interfaceid": "cb535a56-d9b1-4193-bbaf-14a54d385198", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:29.183263 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:29.183621 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:29.184618 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.184851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb535a56-d9, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:29.186015 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.187187 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:29.191501 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.192431 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.192676 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad42fb29-9f8e-4f45-9461-436549426f36) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:29.193242 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.193770 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:29.198246 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.200163 np0000003683 nova-compute[98991]: INFO os_vif [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=cb535a56-d9b1-4193-bbaf-14a54d385198,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535a56-d9')
Jun 26 02:51:29.200544 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Deleting instance files /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b_del
Jun 26 02:51:29.201286 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Deletion of /opt/stack/data/nova/instances/438d9a42-bd81-4489-8c87-68f146dfc61b_del complete
Jun 26 02:51:29.223431 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.441s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:29.289387 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999742622000213 future=<Future at 0x72e27c269b50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:29.291340 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Instance destroyed successfully.
Jun 26 02:51:29.291867 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lazy-loading 'resources' on Instance uuid f94f2230-b9aa-43cd-b423-e86e58e7bb42 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:29.309831 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Deleted allocations for instance 635540bc-bb17-41d4-82c3-39b742a7f65e
Jun 26 02:51:29.709582 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:29.711438 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:29.711749 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:29.711888 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:29.712111 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:29.799032 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-138000110',display_name='tempest-VolumesActionsTest-instance-138000110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-138000110',id=56,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:51:25Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b91d5830f544432d89b9c8613c0a99c6',ramdisk_id='',reservation_id='r-sr0sklw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1779422939',owner_user_name='tempest-VolumesActionsTest-1779422939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:51:25Z,user_data=None,user_id='d2e15651c2d142d9838bb7a85863b775',uuid=f94f2230-b9aa-43cd-b423-e86e58e7bb42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:29.799206 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converting VIF {"id": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "address": "fa:16:3e:b2:e4:92", "network": {"id": "b6064de3-e84c-49b9-83eb-8b08c80d4fb4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1186201185-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b91d5830f544432d89b9c8613c0a99c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47607ed3-b7", "ovs_interfaceid": "47607ed3-b77c-46aa-b6e8-f95842f5631e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:29.799723 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:29.799934 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:29.800859 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.801160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47607ed3-b7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:29.809857 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.812468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:29.812468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.812468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b2b9b9c-5d86-4e24-98e6-d79cc7ddeea0) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:29.812630 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:29.813130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:29.816292 np0000003683 nova-compute[98991]: INFO os_vif [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:92,bridge_name='br-int',has_traffic_filtering=True,id=47607ed3-b77c-46aa-b6e8-f95842f5631e,network=Network(b6064de3-e84c-49b9-83eb-8b08c80d4fb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47607ed3-b7')
Jun 26 02:51:29.816607 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Deleting instance files /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42_del
Jun 26 02:51:29.817228 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Deletion of /opt/stack/data/nova/instances/f94f2230-b9aa-43cd-b423-e86e58e7bb42_del complete
Jun 26 02:51:29.840973 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:30.121056 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:30.210544 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da63c1c6-009d-4c16-9f38-e1da031c86b1 req-af19bdcf-d234-44e0-9e9c-12d2e3ba6731 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Received event network-vif-deleted-cb535a56-d9b1-4193-bbaf-14a54d385198 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:30.210800 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-da63c1c6-009d-4c16-9f38-e1da031c86b1 req-af19bdcf-d234-44e0-9e9c-12d2e3ba6731 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Neutron deleted interface cb535a56-d9b1-4193-bbaf-14a54d385198; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:30.212636 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da63c1c6-009d-4c16-9f38-e1da031c86b1 req-af19bdcf-d234-44e0-9e9c-12d2e3ba6731 service nova] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Detach interface failed, port_id=cb535a56-d9b1-4193-bbaf-14a54d385198, reason: Instance 438d9a42-bd81-4489-8c87-68f146dfc61b could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:30.323513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-bb374cb0-84a1-443e-824f-91430fb6cfaf tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "635540bc-bb17-41d4-82c3-39b742a7f65e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.690s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:30.326882 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:30.327568 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:30.327673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:30.327796 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:30.328154 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:30.382098 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:30.383403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:30.383814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:30.383941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:30.384104 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] No waiting events found dispatching network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:30.384590 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-84367189-1368-4378-9963-23a805d7dc03 req-d330074a-11c0-44bf-ae77-c12a22c2df5b service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:30.515760 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:30.670786 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:30.875059 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8970f08e-e96b-44ce-9bb4-991f72dba915 req-eed8fbd5-2be5-47dc-a0dd-11bc8dff34f3 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-deleted-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:30.875492 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-8970f08e-e96b-44ce-9bb4-991f72dba915 req-eed8fbd5-2be5-47dc-a0dd-11bc8dff34f3 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Neutron deleted interface 47607ed3-b77c-46aa-b6e8-f95842f5631e; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:30.877319 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8970f08e-e96b-44ce-9bb4-991f72dba915 req-eed8fbd5-2be5-47dc-a0dd-11bc8dff34f3 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Detach interface failed, port_id=47607ed3-b77c-46aa-b6e8-f95842f5631e, reason: Instance f94f2230-b9aa-43cd-b423-e86e58e7bb42 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:31.172441 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Took 1.46 seconds to deallocate network for instance.
Jun 26 02:51:31.327346 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:31.678820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:31.678977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:31.827424 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Took 1.50 seconds to deallocate network for instance.
Jun 26 02:51:31.993608 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0013218219996815606 future=<Future at 0x72e29e76e930 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:31.993772 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:31.993830 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.2601135960003376 future=<Future at 0x72e29c4be3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:31.993938 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.2600245900002847 future=<Future at 0x72e29c4be3f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:31.994327 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Emitting event <LifecycleEvent: 1782442276.9921646, 173e3dc3-be91-41bc-b353-ecac928a7c90 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:31.994486 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] VM Stopped (Lifecycle Event)
Jun 26 02:51:32.041002 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:32.041286 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:32.088971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:32.332707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received event network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] Acquiring lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] No waiting events found dispatching network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:32.453442 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1a68c6f7-99ae-41e8-8b81-757538680446 req-c32066c1-727c-4b9b-b4b2-40c1e61ab869 service nova] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Received unexpected event network-vif-unplugged-47607ed3-b77c-46aa-b6e8-f95842f5631e for instance with vm_state deleted and task_state None.
Jun 26 02:51:32.500596 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-540465e9-d89a-4c98-9e68-95d7c8994603 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: 173e3dc3-be91-41bc-b353-ecac928a7c90] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:32.543843 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:33.051336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.372s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:33.053050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.719s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:33.069499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:33.069665 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:33.131863 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance 438d9a42-bd81-4489-8c87-68f146dfc61b
Jun 26 02:51:33.507394 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:33.507394 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:33.542674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:33.543022 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:33.572134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:51:34.011890 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:34.046109 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:34.124933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:34.140228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b65d0f41-79ef-4186-b798-6fea8617ac32 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "438d9a42-bd81-4489-8c87-68f146dfc61b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.301s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:34.365317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:34.365427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:34.365974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:34.365974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:34.365974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:34.367925 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Terminating instance
Jun 26 02:51:34.553811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.502s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:34.556113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.429s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:34.558624 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:51:34.558861 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Claim successful on node np0000003683
Jun 26 02:51:34.625089 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Deleted allocations for instance f94f2230-b9aa-43cd-b423-e86e58e7bb42
Jun 26 02:51:34.813755 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:34.871330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:34.892308 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:34.895206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:34.922064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.016725 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:35.057675 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:35.057931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:35.058147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:35.058289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:35.058425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] No waiting events found dispatching network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:35.058570 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4f82d739-cbb6-4835-9787-5e2b0ee27606 req-2a77275f-2ef5-43ed-b80e-e0ffded1699d service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:35.107654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:35.108330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:35.108330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:35.108330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:35.108592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:35.110405 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Terminating instance
Jun 26 02:51:35.137910 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.144004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.171126 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.180723 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.199217 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999697157000355 future=<Future at 0x72e27c35d0a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.201216 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Instance destroyed successfully.
Jun 26 02:51:35.201735 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'resources' on Instance uuid 34177e20-827a-4fcf-a802-1e99eee882e5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:35.254418 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004094709997843893 future=<Future at 0x72e29c4be3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.255003 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Emitting event <LifecycleEvent: 1782442280.2538855, 2f7efbb6-021e-4bc3-a514-f21f96d3ff29 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:35.255138 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.255426 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] VM Stopped (Lifecycle Event)
Jun 26 02:51:35.256443 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.2540675599998394 future=<Future at 0x72e27c4aa600 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.256844 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=2.253884267999638 future=<Future at 0x72e27c4aa600 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.613758 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:35.634377 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-62a8bf80-aa97-40b0-b5b9-a35678e79614 tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Lock "f94f2230-b9aa-43cd-b423-e86e58e7bb42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.197s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:35.641708 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.644234 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.676140 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.705562 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-566755918',display_name='tempest-TestVolumeBootPatternV346-server-566755918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-566755918',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxHK/d7armTKa8/E7Aqbnif3s9IMhux2LUg1knN/HZbY/3w4Y/fj1bGtbyvrGmU4LYIJoE83LK9HtXxiH6dZMqXYUq2DsnDvGbGTjOfGZBEAtpAJ91DwgOJPo5QEEHyw==',key_name='tempest-keypair-1599760236',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:49:35Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-a2mgs7dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=34177e20-827a-4fcf-a802-1e99eee882e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:35.705810 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "address": "fa:16:3e:06:47:38", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efff377-57", "ovs_interfaceid": "6efff377-57b3-4a30-97d4-923d2bf80ecb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:35.706532 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:35.706824 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:35.713341 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.713840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6efff377-57, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:35.716524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:35.723081 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.726074 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.726301 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0490911f-cbfd-49f8-a519-8bcf91391f73) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:35.728877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:35.734136 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.736404 np0000003683 nova-compute[98991]: INFO os_vif [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:47:38,bridge_name='br-int',has_traffic_filtering=True,id=6efff377-57b3-4a30-97d4-923d2bf80ecb,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efff377-57')
Jun 26 02:51:35.740644 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:35.740962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:35.741113 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:35.741494 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:35.741806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '555c825b-3548-4ec8-8930-0d78ce99c578', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:35.741939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:35.761700 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 2f7efbb6-021e-4bc3-a514-f21f96d3ff29] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:35.803310 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:35.805371 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:35.805765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:35.806102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:35.806739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:35.807631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c47fb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'): ({'sdn'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:35.807799 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Removing multipathed devices sdl, sdn {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:35.807979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flush multipath device 3300000009d62209b {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:35.811726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:35.865767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:35.907343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:35.907593 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:35.915462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:35.949620 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999757259000035 future=<Future at 0x72e27c35e510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:35.950969 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Instance destroyed successfully.
Jun 26 02:51:35.951252 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid c3cca3db-6625-4bb7-b29b-0311e5fa2e22 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:35.989114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if SCSI volumes sdl, sdn have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:35.989304 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] SCSI volumes sdl, sdn have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:35.990762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if device paths {'sdl', 'sdn'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:36.004205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Device paths {'sdl', 'sdn'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:36.004205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:36.016708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.055674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.40.100,3260]
Jun 26 02:51:36.055674 np0000003683 nova-compute[98991]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:36.055674 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.073176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.086074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.095500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:36.095500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:36.095500 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attaching volume 5f3c44af-e4df-4708-b764-ffe26cbedf52 to /dev/vdb
Jun 26 02:51:36.123026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.50.100,3260]
Jun 26 02:51:36.123026 np0000003683 nova-compute[98991]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:36.123026 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.143297 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:36.154349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:36.154349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:36.154349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== disconnect_volume: return (413ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:36.154643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:36.154643 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Deleting instance files /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5_del
Jun 26 02:51:36.155143 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Deletion of /opt/stack/data/nova/instances/34177e20-827a-4fcf-a802-1e99eee882e5_del complete
Jun 26 02:51:36.164691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:51:36.197662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:36.242442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:51:36.243035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517'] 
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:36.257751 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating existing volume attachment record: f67ad156-3dfe-41b5-9535-ed978adbc7e0 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:51:36.412651 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:36.454568 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='multiattach-server-0',id=38,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2xGyVbyPs+Rgwi2wRx5d1flWUFeMi+ffR08ytyv0kzJ87gzOf9c10KkyChXiCuRfNZmQh221bOfhB4fij3/TpTDARuaxyfVZzZI6eBrwyAvP/IUqo4bBoewqCuzyrYA==',key_name='tempest-keypair-1576023500',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:44Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-qq0nxha9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='384ade070e904d66a01f872d9b2c649d',uuid=c3cca3db-6625-4bb7-b29b-0311e5fa2e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:36.454809 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "address": "fa:16:3e:29:66:09", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ef185-f2", "ovs_interfaceid": "9c5ef185-f2c9-4ed9-bc11-c9a503ccab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:36.455450 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:36.455710 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:36.457595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:36.457922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c5ef185-f2, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:36.459411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:36.460944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:36.461728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:36.461880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deaeafcc-e466-4f48-b69e-337dfb363b6b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:36.463553 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:36.465452 np0000003683 nova-compute[98991]: INFO os_vif [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:66:09,bridge_name='br-int',has_traffic_filtering=True,id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ef185-f2')
Jun 26 02:51:36.465777 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Deleting instance files /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22_del
Jun 26 02:51:36.466523 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Deletion of /opt/stack/data/nova/instances/c3cca3db-6625-4bb7-b29b-0311e5fa2e22_del complete
Jun 26 02:51:36.663075 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Took 1.79 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:36.663939 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:36.664326 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:36.664493 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:36.664855 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:36.759779 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:36.818050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:51:36.818536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:36.818731 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:36.924811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.370s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:36.924811 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:51:36.973442 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:36.974013 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:36.974331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:36.974414 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:36.974645 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:37.031009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.212s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:37.031368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:51:37.044776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:37.045446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:37.046065 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:37.046519 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:51:37.046975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:37.047236 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:51:37.060991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:51:37.060991 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:37.062396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:51:37.062396 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52] added
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:37.074485 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:37.074708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:51:37.074843 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:51:37.075012 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52] added
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:37.077939 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:37.078121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:51:37.078247 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:51:37.078393 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:51:37.090661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:37.129702 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:37.149829 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:37.150228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Acquiring lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:37.150312 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:37.150396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "34177e20-827a-4fcf-a802-1e99eee882e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:37.150558 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] No waiting events found dispatching network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:37.150682 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-unplugged-6efff377-57b3-4a30-97d4-923d2bf80ecb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:37.151667 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:37.151806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:37.151979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:37.152133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:37.152255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] No waiting events found dispatching network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:37.152384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:37.152540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:37.152970 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Acquiring lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:37.153180 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:37.153308 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:37.153444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] No waiting events found dispatching network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:37.153853 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a48ff186-8698-4277-92b7-a3be81a03a40 req-90bd8a01-9163-4224-87c8-4a8b8912b4b6 service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-unplugged-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:37.199490 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6e0477f3-7802-48b6-b182-475f447a980d req-4ec4e0db-1177-47f3-8738-e93f1555378a service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Received event network-vif-deleted-6efff377-57b3-4a30-97d4-923d2bf80ecb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:37.199956 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-6e0477f3-7802-48b6-b182-475f447a980d req-4ec4e0db-1177-47f3-8738-e93f1555378a service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Neutron deleted interface 6efff377-57b3-4a30-97d4-923d2bf80ecb; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:37.201548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6e0477f3-7802-48b6-b182-475f447a980d req-4ec4e0db-1177-47f3-8738-e93f1555378a service nova] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Detach interface failed, port_id=6efff377-57b3-4a30-97d4-923d2bf80ecb, reason: Instance 34177e20-827a-4fcf-a802-1e99eee882e5 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:37.398883 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1465810a-9737-4c31-bb9c-88718fa94c6c req-5f6aea21-c26e-4be0-bcee-d1a35275059d service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Received event network-vif-deleted-9c5ef185-f2c9-4ed9-bc11-c9a503ccab27 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:37.399161 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-1465810a-9737-4c31-bb9c-88718fa94c6c req-5f6aea21-c26e-4be0-bcee-d1a35275059d service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Neutron deleted interface 9c5ef185-f2c9-4ed9-bc11-c9a503ccab27; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:37.400691 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1465810a-9737-4c31-bb9c-88718fa94c6c req-5f6aea21-c26e-4be0-bcee-d1a35275059d service nova] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Detach interface failed, port_id=9c5ef185-f2c9-4ed9-bc11-c9a503ccab27, reason: Instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:37.430955 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:51:37.431831 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:51:37.432106 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:37.432366 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:37.497825 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9cfcb756f384dbdaaa22c52c213f9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113949dbf75c4f588d00edb88ac841e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:51:37.510891 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003556090000529366 future=<Future at 0x72e27c4aa600 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:37.510995 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:37.511067 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=6.163252838000062 future=<Future at 0x72e27c2a90d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:37.511152 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=6.163176075000138 future=<Future at 0x72e27c2a90d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:37.511620 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Emitting event <LifecycleEvent: 1782442282.510441, 635540bc-bb17-41d4-82c3-39b742a7f65e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:37.511783 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] VM Stopped (Lifecycle Event)
Jun 26 02:51:37.640391 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:37.857559 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:37.932486 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Successfully created port: 43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:51:37.934504 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:51:38.014762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1e95ac24-3b21-490a-902b-dc8ff65b377f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 635540bc-bb17-41d4-82c3-39b742a7f65e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:38.075687 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:51:38.078870 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:51:38.088395 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:51:38.094559 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.100906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.107375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.115605 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.115750 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.122770 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.122977 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:38.142276 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Took 1.48 seconds to deallocate network for instance.
Jun 26 02:51:38.157195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.40.100,3260]
Jun 26 02:51:38.157195 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:38.157195 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.162680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.50.100,3260]
Jun 26 02:51:38.162680 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:38.162680 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.169447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.174401 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.184717 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.185714 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:38.186515 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:38.186515 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:51:38.187466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] HCTL ('7', '-', '-', 0) found on session 134 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:51:38.187665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.193153 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:38.193394 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:38.193681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:38.193795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:51:38.194568 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] HCTL ('9', '-', '-', 0) found on session 135 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:51:38.194634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:51:38.207433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching for a device in session 134 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:51:38.207433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:51:38.210446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching for a device in session 135 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:51:38.210596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:51:38.359388 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Took 1.38 seconds to deallocate network for instance.
Jun 26 02:51:38.435224 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Successfully updated port: 43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:51:38.437884 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:51:38.691515 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:51:38.865694 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:38.866061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:38.937564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:51:38.937910 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquired lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:51:38.938246 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:51:39.046845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:51:39.159193 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:39.159398 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:39.196083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:39.258232 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-changed-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:39.258659 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Refreshing instance network info cache due to event network-changed-43602d6d-8505-44e4-925a-5078e49dc0b2. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:51:39.258834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] Acquiring lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:51:39.446012 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:51:39.446947 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:51:39.447182 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Creating image(s)
Jun 26 02:51:39.447698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:39.447853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:39.448529 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:39.449079 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:39.452835 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:39.453918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:39.521914 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:51:39.545741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:39.546248 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:39.546700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:39.547205 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:39.549638 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:51:39.549976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:39.640493 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:39.641067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:39.665764 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:39.700009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk 1073741824" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:39.700504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:39.700908 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:39.721712 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:39.791333 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:39.791811 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:51:39.792113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:39.862093 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updating instance_info_cache with network_info: [{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:39.883234 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:39.883641 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Cannot resize image /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:51:39.883931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:51:39.884104 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Ensure instance console log exists: /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:51:39.884598 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:39.884730 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:39.884852 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:40.062444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found WWN 330000000429bd32e for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:51:40.062906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:40.063114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== connect_volume: return (3244ms) {'type': 'block', 'scsi_wwn': '330000000429bd32e', 'path': '/dev/dm-0', 'multipath_id': '330000000429bd32e'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:40.063276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000429bd32e', 'path': '/dev/dm-0', 'multipath_id': '330000000429bd32e'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:51:40.067389 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:40.177379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.311s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:40.179602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.982s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:40.251183 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance c3cca3db-6625-4bb7-b29b-0311e5fa2e22
Jun 26 02:51:40.364551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Releasing lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:51:40.364934 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Instance network_info: |[{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:51:40.365876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] Acquired lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:51:40.366052 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Refreshing network info cache for port 43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:51:40.368315 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Start _get_guest_xml network_info=[{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:51:40.371261 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:51:40.372538 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191', uuid='1c9a1187-f037-466d-a024-edd1c1387e64'), owner=OwnerMeta(userid='f9cfcb756f384dbdaaa22c52c213f9ce', username='tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member', projectid='113949dbf75c4f588d00edb88ac841e3', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-594246316'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442300.3721416) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:51:40.374884 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:51:40.375226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:51:40.376929 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:51:40.377101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:51:40.378067 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:51:40.378499 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:51:40.378646 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:51:40.378735 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:51:40.378864 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:51:40.378942 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:51:40.379030 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:51:40.379230 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:51:40.379269 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:51:40.379914 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:51:40.379914 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:51:40.379914 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:51:40.389471 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachscenariooldversion-server-2132748',id=57,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw/KkyeFr5g4BFxBD9XMai4SaLaajAqleJ8hDbZmERHuRM2NiQJMfyrluTQ/85o3/q5jTABDAEtGbNthXRxMMiGJxJPXWZsp5c/FC5b5zf5x5XAD8/vTVE93+AhvRruSg==',key_name='tempest-keypair-2090029325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113949dbf75c4f588d00edb88ac841e3',ramdisk_id='',reservation_id='r-lfdcogq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:51:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9cfcb756f384dbdaaa22c52c213f9ce',uuid=1c9a1187-f037-466d-a024-edd1c1387e64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:51:40.389671 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converting VIF {"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:40.390195 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:40.390637 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:40.502180 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:40.502420 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:40.570700 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attempting to attach volume 5f3c44af-e4df-4708-b764-ffe26cbedf52 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:   <alias name="ua-5f3c44af-e4df-4708-b764-ffe26cbedf52"/>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:   <serial>5f3c44af-e4df-4708-b764-ffe26cbedf52</serial>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:40.572056 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:51:40.869741 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <uuid>1c9a1187-f037-466d-a024-edd1c1387e64</uuid>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <name>instance-00000039</name>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191</nova:name>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:51:40</nova:creationTime>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:user uuid="f9cfcb756f384dbdaaa22c52c213f9ce">tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member</nova:user>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:project uuid="113949dbf75c4f588d00edb88ac841e3">tempest-TestServerVolumeAttachScenarioOldVersion-594246316</nova:project>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         <nova:port uuid="43602d6d-8505-44e4-925a-5078e49dc0b2">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="serial">1c9a1187-f037-466d-a024-edd1c1387e64</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="uuid">1c9a1187-f037-466d-a024-edd1c1387e64</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.config"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b3:3a:57"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <target dev="tap43602d6d-85"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/console.log" append="off"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:51:40.893939 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:51:40.895990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Preparing to wait for external event network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:51:40.895990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:40.895990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:40.895990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:40.895990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachscenariooldversion-server-2132748',id=57,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw/KkyeFr5g4BFxBD9XMai4SaLaajAqleJ8hDbZmERHuRM2NiQJMfyrluTQ/85o3/q5jTABDAEtGbNthXRxMMiGJxJPXWZsp5c/FC5b5zf5x5XAD8/vTVE93+AhvRruSg==',key_name='tempest-keypair-2090029325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113949dbf75c4f588d00edb88ac841e3',ramdisk_id='',reservation_id='r-lfdcogq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:51:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9cfcb756f384dbdaaa22c52c213f9ce',uuid=1c9a1187-f037-466d-a024-edd1c1387e64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:51:40.896218 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converting VIF {"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:40.896880 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:40.897246 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:51:40.897838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.898265 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:40.898584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:51:40.900254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.900496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7afe484b-ac03-5c38-8d3e-f2bf0c49c0f5', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:40.901967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.903102 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:40.905020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.905251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43602d6d-85, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:40.905757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43602d6d-85, col_values=(('qos', UUID('dd4590de-debf-4a01-a82d-a3461cf7c4bb')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:40.905880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43602d6d-85, col_values=(('external_ids', {'iface-id': '43602d6d-8505-44e4-925a-5078e49dc0b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:3a:57', 'vm-uuid': '1c9a1187-f037-466d-a024-edd1c1387e64'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:40.907934 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.908399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:40.915776 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:40.916923 np0000003683 nova-compute[98991]: INFO os_vif [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85')
Jun 26 02:51:41.005306 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:41.170712 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:41.259753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3e50d8a7-a339-4fff-8bd2-b7b3f1dc31a0 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "c3cca3db-6625-4bb7-b29b-0311e5fa2e22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.152s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:41.292515 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updated VIF entry in instance network info cache for port 43602d6d-8505-44e4-925a-5078e49dc0b2. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:51:41.292780 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updating instance_info_cache with network_info: [{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:41.512537 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.335s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:41.563146 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Deleted allocations for instance 34177e20-827a-4fcf-a802-1e99eee882e5
Jun 26 02:51:41.794403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef7d3b98-e8ea-4859-9ceb-b615800d84c7 req-feff754a-4f08-4f71-98db-e5cc05efc6fb service nova] Releasing lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:51:42.091844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:42.213873 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:42.214014 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:42.214142 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:42.214221 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No VIF found with MAC fa:16:3e:58:ad:7f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:51:42.432054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:42.432226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:42.432373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No VIF found with MAC fa:16:3e:b3:3a:57, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:51:42.432840 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Using config drive
Jun 26 02:51:42.572119 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a17c5757-7ee0-4a8c-9bb1-18142de09dcc tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "34177e20-827a-4fcf-a802-1e99eee882e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.207s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:42.626777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:42.626961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:42.627146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:42.627307 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:42.627415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:42.629632 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Terminating instance
Jun 26 02:51:42.937922 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:43.052778 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Creating config drive at /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.config
Jun 26 02:51:43.056541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbw5jlitz {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:43.112471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbw5jlitz" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:43.133298 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:43.170217 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.172370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.188729 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.198215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.223933 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.234225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.317898 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:43.318378 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:43.318593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:43.318716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:43.318851 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] No waiting events found dispatching network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:43.318936 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d5337e78-8323-4a5e-b031-1f3dfba84fd6 req-0a592921-397c-46df-9021-39e80edafdcf service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:43.612557 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999604033000196 future=<Future at 0x72e29c4ac590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:43.614948 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Instance destroyed successfully.
Jun 26 02:51:43.615804 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lazy-loading 'resources' on Instance uuid fbf319d1-e938-4727-8ed3-2275ec9bd8c2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:43.625250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.663349 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.675042 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003679679998640495 future=<Future at 0x72e27c2a90d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:43.675042 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:43.675042 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.6140874630000326 future=<Future at 0x72e27c269b50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:43.675042 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.6140111409999918 future=<Future at 0x72e27c269b50 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:43.677730 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] Emitting event <LifecycleEvent: 1782442288.6742694, 438d9a42-bd81-4489-8c87-68f146dfc61b => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:43.677730 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] VM Stopped (Lifecycle Event)
Jun 26 02:51:43.741843 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.770317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-976da5a4-1457-4d03-a1bf-396cfe1b6049 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.677s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:43.816702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671d7811-c332-497e-a561-723d14d17009 req-1670a47a-18a9-450c-9040-8a76c0343a18 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:43.816829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671d7811-c332-497e-a561-723d14d17009 req-1670a47a-18a9-450c-9040-8a76c0343a18 service nova] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:43.817022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671d7811-c332-497e-a561-723d14d17009 req-1670a47a-18a9-450c-9040-8a76c0343a18 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:43.817404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-671d7811-c332-497e-a561-723d14d17009 req-1670a47a-18a9-450c-9040-8a76c0343a18 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:43.817404 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-671d7811-c332-497e-a561-723d14d17009 req-1670a47a-18a9-450c-9040-8a76c0343a18 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Processing event network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:51:43.947719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.952957 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.986403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:43.992610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.119781 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1547132050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-attachvolumemultiattachtest-server-1547132050',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:46:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2b74afe940c40d490cd930d9056fc92',ramdisk_id='',reservation_id='r-uyj8tca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1323859006',owner_user_name='tempest-AttachVolumeMultiAttachTest-1323859006-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:46:27Z,user_data=None,user_id='384ade070e904d66a01f872d9b2c649d',uuid=fbf319d1-e938-4727-8ed3-2275ec9bd8c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:44.120327 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converting VIF {"id": "91f954d1-a626-4f25-b4c3-6506911b864d", "address": "fa:16:3e:52:a7:ac", "network": {"id": "a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352168361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2b74afe940c40d490cd930d9056fc92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f954d1-a6", "ovs_interfaceid": "91f954d1-a626-4f25-b4c3-6506911b864d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:44.120923 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:44.121095 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:44.122459 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.122771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f954d1-a6, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:44.123820 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.124676 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:44.125487 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.125655 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8bd879b-3aa6-479f-aa85-c3ef8e3039a8) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:44.126068 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.126618 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:44.126871 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:44.128528 np0000003683 nova-compute[98991]: INFO os_vif [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a7:ac,bridge_name='br-int',has_traffic_filtering=True,id=91f954d1-a626-4f25-b4c3-6506911b864d,network=Network(a94cb0f8-ad9a-44a1-9ff8-09e7ac8b41c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f954d1-a6')
Jun 26 02:51:44.162322 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:44.162684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:44.162859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:44.180039 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9b7c7dc4-ea1b-4ea0-84d1-f53dff9eb56f tempest-VolumesActionsTest-1779422939 tempest-VolumesActionsTest-1779422939-project-member] [instance: 438d9a42-bd81-4489-8c87-68f146dfc61b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:44.289608 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005765759997302666 future=<Future at 0x72e27c269b50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:44.290291 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Emitting event <LifecycleEvent: 1782442289.2889397, f94f2230-b9aa-43cd-b423-e86e58e7bb42 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:44.290466 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] VM Stopped (Lifecycle Event)
Jun 26 02:51:44.291637 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:44.291792 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.907097328999953 future=<Future at 0x72e27c35d0a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:44.291886 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.906975191000129 future=<Future at 0x72e27c35d0a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:44.374255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.211s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:44.374641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:44.375328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:44.376520 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:51:44.377037 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442304.3766904, 1c9a1187-f037-466d-a024-edd1c1387e64 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:44.377194 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] VM Started (Lifecycle Event)
Jun 26 02:51:44.379420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:51:44.381544 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Instance spawned successfully.
Jun 26 02:51:44.381877 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:44.404900 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:44.405384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:44.406375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:44.408724 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4a7880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:44.410082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:44.410362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Flush multipath device 330000000bcc8983d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:44.467989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:44.519975 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:44.568803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:44.568989 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:44.570041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:44.583606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:44.583606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:44.593761 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.639767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.40.100,3260]
Jun 26 02:51:44.639767 np0000003683 nova-compute[98991]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:44.639767 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.659533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.675945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.715957 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.50.100,3260]
Jun 26 02:51:44.715957 np0000003683 nova-compute[98991]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:44.715957 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.735561 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:44.735904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:44.736099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] <== disconnect_volume: return (573ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:44.736337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:44.736743 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Deleting instance files /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2_del
Jun 26 02:51:44.737431 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Deletion of /opt/stack/data/nova/instances/fbf319d1-e938-4727-8ed3-2275ec9bd8c2_del complete
Jun 26 02:51:44.794848 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: f94f2230-b9aa-43cd-b423-e86e58e7bb42] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:44.881571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:44.885886 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:44.890576 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.890773 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.891269 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.891680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.892050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.892413 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:51:44.944626 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:44.944827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:45.244606 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Took 2.11 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:45.245232 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:45.245606 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:45.245808 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:45.246104 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:45.271430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:45.271430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:45.271430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:45.271430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:45.271430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:45.273451 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Terminating instance
Jun 26 02:51:45.314377 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:45.389144 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:51:45.389557 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442305.38927, 1c9a1187-f037-466d-a024-edd1c1387e64 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:45.389742 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] VM Paused (Lifecycle Event)
Jun 26 02:51:45.397083 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Took 5.95 seconds to spawn the instance on the hypervisor.
Jun 26 02:51:45.397236 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:45.405188 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:45.406007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] Acquiring lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:45.406347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:45.406548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:45.406967 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] No waiting events found dispatching network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:45.407138 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-619e6bb9-b9fb-4dea-ad04-0a05ad4da54c req-3bc4cd59-caf1-4696-a008-ddf77d524184 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-unplugged-91f954d1-a626-4f25-b4c3-6506911b864d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:45.449119 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:45.777262 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:51:45.798743 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.803370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.832426 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.840580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.880983 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.882973 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:45.895661 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:45.910299 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442305.9097822, 1c9a1187-f037-466d-a024-edd1c1387e64 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:45.910529 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] VM Resumed (Lifecycle Event)
Jun 26 02:51:45.912342 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Took 11.84 seconds to build instance.
Jun 26 02:51:45.928947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:45.929114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:45.929346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:45.929455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:45.929877 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] No waiting events found dispatching network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:45.930117 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c2e364b3-3a33-4c83-a2d7-4bf9dd1b8eee req-ffc747de-17d3-43e9-839a-d4b1f26433c9 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received unexpected event network-vif-plugged-43602d6d-8505-44e4-925a-5078e49dc0b2 for instance with vm_state active and task_state None.
Jun 26 02:51:46.011917 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:46.012911 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:46.013407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:46.013407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:46.013407 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] No waiting events found dispatching network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:46.013541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b2e4978-7f29-45f0-b147-eded68aca98c req-0d2cc3ed-18d7-42fc-8c6b-5026a36646c3 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:46.100705 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:46.141086 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Instance destroyed successfully.
Jun 26 02:51:46.141538 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lazy-loading 'resources' on Instance uuid ecba11d0-cb36-45bd-afce-8a4a2666c369 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:46.414190 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:46.416967 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:51:46.418974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.349s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:46.458689 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:46.603923 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Took 1.36 seconds to deallocate network for instance.
Jun 26 02:51:46.646566 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-7596561',display_name='tempest-TestVolumeBootPatternV346-server-7596561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpatternv346-server-7596561',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzoZz/vozZEekxjG7Eb7ttw8Xnf9ue4cUrHfqj4mK1NC5qY5tKJnROwQbw3S+9c+aBQ6UsLdwhMVT4qcsARGUJ79cVnWmKBtUb5jcVZVhe+Bt5E9bWLD7tVUJTb9jGBgA==',key_name='tempest-keypair-350272651',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:48:31Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='addc661d189b4a8c8e130200e4d2c30a',ramdisk_id='',reservation_id='r-uquos0w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-766983106',owner_user_name='tempest-TestVolumeBootPatternV346-766983106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabf44f7bd7d4f0bb60de94c0db9de53',uuid=ecba11d0-cb36-45bd-afce-8a4a2666c369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:51:46.646566 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converting VIF {"id": "f54efd61-0762-4cb1-9190-babcc576ccb0", "address": "fa:16:3e:14:95:1c", "network": {"id": "700a338e-41c0-47c7-b922-539681950990", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-476802006-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "addc661d189b4a8c8e130200e4d2c30a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54efd61-07", "ovs_interfaceid": "f54efd61-0762-4cb1-9190-babcc576ccb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:51:46.646945 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:51:46.647594 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:51:46.650973 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.651272 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf54efd61-07, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:46.654079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.654950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.655402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:46.658764 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.659488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.659543 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d63a10d-e111-4419-a94c-2b0c80478cd1) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:51:46.664067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:46.665145 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:51:46.671430 np0000003683 nova-compute[98991]: INFO os_vif [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:1c,bridge_name='br-int',has_traffic_filtering=True,id=f54efd61-0762-4cb1-9190-babcc576ccb0,network=Network(700a338e-41c0-47c7-b922-539681950990),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54efd61-07')
Jun 26 02:51:46.674656 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:46.675182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:46.675346 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:46.919763 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999782434999815 future=<Future at 0x72e27c2202f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:47.094771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:47.195147 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Took 0.59 seconds to detach 1 volumes for instance.
Jun 26 02:51:47.469269 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8ab30c67-90c9-44a7-853c-042e690eb627 req-d369f3c0-b2ee-4baa-951e-9123f991c029 service nova] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Received event network-vif-deleted-91f954d1-a626-4f25-b4c3-6506911b864d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:47.704991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:47.704991 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:47.788637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:47.788945 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:47.789428 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attaching volume 60f7f564-2c89-4c17-bc68-049bc6019b56 to /dev/vdc
Jun 26 02:51:47.863663 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:47.883785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:51:47.917327 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:47.967449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:51:47.967588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:51:47.978675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:51:47.979615 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] 
Jun 26 02:51:47.979705 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:51:47.979807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:51:47.980201 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:47.980201 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating existing volume attachment record: a52d0c17-11af-480d-b3c4-47efda0d009f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:51:48.038912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:48.038912 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:48.094927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:48.095118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Acquiring lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:48.095523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:48.095523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:48.095647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] No waiting events found dispatching network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:51:48.095693 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-unplugged-f54efd61-0762-4cb1-9190-babcc576ccb0 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:51:48.095776 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-changed-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:48.095877 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Refreshing instance network info cache due to event network-changed-43602d6d-8505-44e4-925a-5078e49dc0b2. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:51:48.096817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Acquiring lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:51:48.096817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Acquired lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:51:48.096817 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Refreshing network info cache for port 43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:51:48.542907 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:48.577033 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:51:48.577033 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:48.577733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:48.604461 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:49.027605 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:49.052655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.348s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:49.137919 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Deleted allocations for instance fbf319d1-e938-4727-8ed3-2275ec9bd8c2
Jun 26 02:51:49.234857 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updated VIF entry in instance network info cache for port 43602d6d-8505-44e4-925a-5078e49dc0b2. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:51:49.235147 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updating instance_info_cache with network_info: [{"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:49.436428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.761s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:49.437103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76e72eb2-642a-4440-b292-3986774c1094', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:51:49.437103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash)
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c27fe20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:51:49.468502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Flush multipath device 3300000005c5d188e {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:51:49.530415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:49.580920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:51:49.645892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:51:49.645892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:51:49.648250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:51:49.666510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:51:49.666510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:51:49.682415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.718836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.40.100,3260]
Jun 26 02:51:49.718836 np0000003683 nova-compute[98991]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:49.718836 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.740980 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.741882 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b98b9a79-2652-4072-83fa-bfb09a085b57 req-92b244a3-15f4-4fe8-b979-c50d4636cea4 service nova] Releasing lock "refresh_cache-1c9a1187-f037-466d-a024-edd1c1387e64" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:51:49.753627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.795292 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.50.100,3260]
Jun 26 02:51:49.795292 np0000003683 nova-compute[98991]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:49.795292 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.815759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.816094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:49.816662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] <== disconnect_volume: return (3140ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:49.817298 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:51:49.817298 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Deleting instance files /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369_del
Jun 26 02:51:49.817523 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.240s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:49.817954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:51:49.818695 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Deletion of /opt/stack/data/nova/instances/ecba11d0-cb36-45bd-afce-8a4a2666c369_del complete
Jun 26 02:51:49.834571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:49.835326 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:49.836976 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:49.837261 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:51:49.837924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:51:49.838233 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:51:49.854056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:51:49.854056 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.861126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:51:49.861126 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56] added
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:49.878854 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.879335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:51:49.879599 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:51:49.879599 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56] added
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:51:49.881718 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:49.881894 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:51:49.882078 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:51:49.882327 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:51:50.150845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2cb41062-c93a-4d09-b8ed-c7a680a17221 tempest-AttachVolumeMultiAttachTest-1323859006 tempest-AttachVolumeMultiAttachTest-1323859006-project-member] Lock "fbf319d1-e938-4727-8ed3-2275ec9bd8c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.524s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:50.199527 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005899279999539431 future=<Future at 0x72e27c35d0a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.199714 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.199882 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.7495563309998943 future=<Future at 0x72e27c35e510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.199882 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=0.7494708919998629 future=<Future at 0x72e27c35e510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.200619 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Emitting event <LifecycleEvent: 1782442295.1988037, 34177e20-827a-4fcf-a802-1e99eee882e5 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:50.200849 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] VM Stopped (Lifecycle Event)
Jun 26 02:51:50.334815 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Took 4.56 seconds to destroy the instance on the hypervisor.
Jun 26 02:51:50.338503 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:51:50.339269 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:51:50.339269 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:51:50.339269 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:50.421154 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:51:50.708349 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 34177e20-827a-4fcf-a802-1e99eee882e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:50.880211 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:51:50.882824 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:51:50.896281 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:51:50.908866 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:50.913969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:50.928536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:50.948180 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:50.949875 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004596190001393552 future=<Future at 0x72e27c35e510 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.950018 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.950302 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.661977590999868 future=<Future at 0x72e29c4ac590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.950352 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=7.661779071000183 future=<Future at 0x72e29c4ac590 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:50.951320 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442295.9493062, c3cca3db-6625-4bb7-b29b-0311e5fa2e22 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:50.951511 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] VM Stopped (Lifecycle Event)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:50.977029 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:51.012559 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.50.100,3260]
Jun 26 02:51:51.012559 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.50.100,3260] successful.
Jun 26 02:51:51.012559 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:51.033288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:51.049147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.40.100,3260]
Jun 26 02:51:51.049147 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.40.100,3260] successful.
Jun 26 02:51:51.049147 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.057894 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.058194 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:51.058458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:51.058542 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:51:51.059313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] HCTL ('11', '-', '-', 0) found on session 140 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:51:51.059456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:51:51.066908 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:51:51.086385 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e0799412-4839-4d4b-8f2d-aa146dac282a req-632c9429-0aba-4783-99b0-18ebec63341d service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Received event network-vif-deleted-f54efd61-0762-4cb1-9190-babcc576ccb0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:51:51.091935 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-e0799412-4839-4d4b-8f2d-aa146dac282a req-632c9429-0aba-4783-99b0-18ebec63341d service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Neutron deleted interface f54efd61-0762-4cb1-9190-babcc576ccb0; detaching it from the instance and deleting it from the info cache
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.092177 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:51:51.098409 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:51:51.099803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.261s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:51.099803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:51:51.099803 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e0799412-4839-4d4b-8f2d-aa146dac282a req-632c9429-0aba-4783-99b0-18ebec63341d service nova] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Detach interface failed, port_id=f54efd61-0762-4cb1-9190-babcc576ccb0, reason: Instance ecba11d0-cb36-45bd-afce-8a4a2666c369 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:51:51.102589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching for a device in session 140 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:51:51.102589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:51:51.102589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] HCTL ('12', '-', '-', 0) found on session 141 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:51:51.102589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:51:51.118782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Searching for a device in session 141 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:51:51.120818 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:51:51.347003 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:51.347290 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:51:51.456496 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: c3cca3db-6625-4bb7-b29b-0311e5fa2e22] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:51.521585 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:51:51.663561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:51.837671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:51:52.024527 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Took 1.68 seconds to deallocate network for instance.
Jun 26 02:51:52.096793 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:52.343900 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:52.605771 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Took 0.58 seconds to detach 1 volumes for instance.
Jun 26 02:51:52.850915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:52.851372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:52.851372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:52.851569 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:51:52.861667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found WWN 3300000007f357d3b for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:51:52.862103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:51:52.863345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== connect_volume: return (4285ms) {'type': 'block', 'scsi_wwn': '3300000007f357d3b', 'path': '/dev/dm-2', 'multipath_id': '3300000007f357d3b'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:51:52.863868 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f357d3b', 'path': '/dev/dm-2', 'multipath_id': '3300000007f357d3b'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:51:52.871563 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:51:53.113897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:53.114112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:53.320216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:53.320373 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:53.375206 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attempting to attach volume 60f7f564-2c89-4c17-bc68-049bc6019b56 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:   <alias name="ua-60f7f564-2c89-4c17-bc68-049bc6019b56"/>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:   <serial>60f7f564-2c89-4c17-bc68-049bc6019b56</serial>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:53.376686 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:51:53.823043 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:53.831113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:53.896597 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:54.050459 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:54.051050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:54.169402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:54.175607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:54.302092 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:54.302585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:54.336068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.221s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:54.402315 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Deleted allocations for instance ecba11d0-cb36-45bd-afce-8a4a2666c369
Jun 26 02:51:54.418824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:54.419109 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:51:54.419253 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:51:54.428121 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:51:54.429283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:51:54.488693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:51:54.491930 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50969MB free_disk=72.65623474121094GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:51:54.492257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:54.492407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:55.084783 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:55.085133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:55.085133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:55.085133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:51:55.085225 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] No VIF found with MAC fa:16:3e:58:ad:7f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:51:55.412268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-83a8502c-3ef2-4f4a-99e4-e5343aeb4b6d tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Lock "ecba11d0-cb36-45bd-afce-8a4a2666c369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.141s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:55.576745 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 89077a65-79ce-406a-9fca-bcbac51a89ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:51:55.577064 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 1c9a1187-f037-466d-a024-edd1c1387e64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:51:55.577134 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:51:55.577346 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:51:54 up 38 min,  2 users,  load average: 9.81, 8.18, 5.07\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_1d9d0803e00c49998563cf202a69ab1c': '1', 'io_workload': '0', 'num_proj_113949dbf75c4f588d00edb88ac841e3': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:51:55.736226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:51:55.736667 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:51:56.240115 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:51:56.662583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-471dd1b2-b550-4eea-af94-9e2106fd605b tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.874s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:56.667367 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:56.746088 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:51:56.746234 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.254s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:51:56.746556 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:51:57.098761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:51:57.664219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:51:57.664219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:51:57.746741 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.747037 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.747345 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.747598 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.747845 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.748065 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.748289 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:51:57.748446 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:51:57.748712 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.59 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:51:58.166779 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Detaching volume 60f7f564-2c89-4c17-bc68-049bc6019b56
Jun 26 02:51:58.212669 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attempting to driver detach volume 60f7f564-2c89-4c17-bc68-049bc6019b56 from mountpoint /dev/vdc
Jun 26 02:51:58.217209 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found disk vdc by alias ua-60f7f564-2c89-4c17-bc68-049bc6019b56 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:51:58.218751 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found disk vdc by alias ua-60f7f564-2c89-4c17-bc68-049bc6019b56 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:51:58.218875 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Attempting to detach device vdc from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <alias name="ua-60f7f564-2c89-4c17-bc68-049bc6019b56"/>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <serial>60f7f564-2c89-4c17-bc68-049bc6019b56</serial>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:58.219112 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:51:58.226010 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully detached device vdc from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the persistent domain config.
Jun 26 02:51:58.226192 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] (1/8): Attempting to detach device vdc with device alias ua-60f7f564-2c89-4c17-bc68-049bc6019b56 from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <alias name="ua-60f7f564-2c89-4c17-bc68-049bc6019b56"/>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <serial>60f7f564-2c89-4c17-bc68-049bc6019b56</serial>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:51:58.226456 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:51:58.612709 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005245329998615489 future=<Future at 0x72e29c4ac590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:58.613161 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Emitting event <LifecycleEvent: 1782442303.6120214, fbf319d1-e938-4727-8ed3-2275ec9bd8c2 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:51:58.613342 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:58.613544 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] VM Stopped (Lifecycle Event)
Jun 26 02:51:58.614520 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.3050405620001584 future=<Future at 0x72e27c2202f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:58.614627 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=3.3049040979999518 future=<Future at 0x72e27c2202f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:51:58.738142 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442318.7377706, 89077a65-79ce-406a-9fca-bcbac51a89ba => ua-60f7f564-2c89-4c17-bc68-049bc6019b56> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:51:58.739600 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-60f7f564-2c89-4c17-bc68-049bc6019b56 for instance 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:51:58.744360 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully detached device vdc from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the live domain config.
Jun 26 02:51:58.747347 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:51:58.747665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:51:58.747785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:51:59.116075 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: fbf319d1-e938-4727-8ed3-2275ec9bd8c2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:51:59.193560 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:01.231941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:01.510892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.763s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:01.511298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60f7f564-2c89-4c17-bc68-049bc6019b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:52:01.511514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:01.564222 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:01.564823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '143')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:52:01.564823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '141')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:01.565646 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '140')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:01.566850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c48cf40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'): ({'sdf'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:52:01.566850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:52:01.567314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Flush multipath device 3300000007f357d3b {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:52:01.604826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:01.659451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:01.670323 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:01.716922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:52:01.717201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:52:01.718439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:52:01.733929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:52:01.733929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:52:01.746835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.780127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.40.100,3260]
Jun 26 02:52:01.780127 np0000003683 nova-compute[98991]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.40.100,3260] successful.
Jun 26 02:52:01.780127 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.797250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.813620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.852945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.50.100,3260]
Jun 26 02:52:01.852945 np0000003683 nova-compute[98991]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56, portal: 192.168.50.100,3260] successful.
Jun 26 02:52:01.852945 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.883331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:01.883331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:01.883331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== disconnect_volume: return (3132ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:01.883331 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:52:01.920218 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.000628719999895111 future=<Future at 0x72e27c2202f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:01.921954 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Emitting event <LifecycleEvent: 1782442306.919465, ecba11d0-cb36-45bd-afce-8a4a2666c369 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:01.922185 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:01.922372 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] VM Stopped (Lifecycle Event)
Jun 26 02:52:02.101944 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:02.425054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: ecba11d0-cb36-45bd-afce-8a4a2666c369] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:02.448500 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:03.461349 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a94232c6-b20f-4f94-9e82-d8920673e2cd tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.798s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:04.262368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:04.262649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:04.731329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:04.765988 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Detaching volume 5f3c44af-e4df-4708-b764-ffe26cbedf52
Jun 26 02:52:04.813334 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Attempting to driver detach volume 5f3c44af-e4df-4708-b764-ffe26cbedf52 from mountpoint /dev/vdb
Jun 26 02:52:04.820660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found disk vdb by alias ua-5f3c44af-e4df-4708-b764-ffe26cbedf52 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:52:04.824377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Found disk vdb by alias ua-5f3c44af-e4df-4708-b764-ffe26cbedf52 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:52:04.824989 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Attempting to detach device vdb from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <alias name="ua-5f3c44af-e4df-4708-b764-ffe26cbedf52"/>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <serial>5f3c44af-e4df-4708-b764-ffe26cbedf52</serial>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:52:04.825371 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:52:04.836831 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully detached device vdb from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the persistent domain config.
Jun 26 02:52:04.837989 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] (1/8): Attempting to detach device vdb with device alias ua-5f3c44af-e4df-4708-b764-ffe26cbedf52 from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <alias name="ua-5f3c44af-e4df-4708-b764-ffe26cbedf52"/>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <serial>5f3c44af-e4df-4708-b764-ffe26cbedf52</serial>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:52:04.838311 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:52:05.408416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442325.4080684, 89077a65-79ce-406a-9fca-bcbac51a89ba => ua-5f3c44af-e4df-4708-b764-ffe26cbedf52> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:52:05.409175 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5f3c44af-e4df-4708-b764-ffe26cbedf52 for instance 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:52:05.411591 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully detached device vdb from instance 89077a65-79ce-406a-9fca-bcbac51a89ba from the live domain config.
Jun 26 02:52:05.413105 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:52:05.413512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:05.413714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:06.367924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.954s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:06.368333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f3c44af-e4df-4708-b764-ffe26cbedf52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:52:06.368540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash)
Jun 26 02:52:06.398257 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash)
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash)
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash)
Jun 26 02:52:06.398524 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:06.398689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', '144')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:52:06.398846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:06.399934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:06.400935 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c581120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:52:06.401178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Removing multipathed devices sdd, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:52:06.401448 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Flush multipath device 330000000429bd32e {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:52:06.439452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:06.505881 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:06.551425 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:06.566992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Checking to see if SCSI volumes sdd, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:52:06.567181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] SCSI volumes sdd, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:52:06.567946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Checking to see if device paths {'sdd', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:52:06.579752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Device paths {'sdd', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:52:06.579934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:52:06.593231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.623657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.40.100,3260]
Jun 26 02:52:06.623657 np0000003683 nova-compute[98991]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.40.100,3260] successful.
Jun 26 02:52:06.623657 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.640765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.655510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.671973 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:06.692400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.50.100,3260]
Jun 26 02:52:06.692400 np0000003683 nova-compute[98991]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52, portal: 192.168.50.100,3260] successful.
Jun 26 02:52:06.692400 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.717802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:06.718098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:06.718278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] <== disconnect_volume: return (1304ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:06.718324 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:52:07.106271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:07.300273 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'flavor' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:07.730238 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:52:08.308183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f7036134-4907-49d1-b093-4eb3517befc3 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:08.708669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:08.708887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:08.709196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:08.709401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:08.709584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:08.711861 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Terminating instance
Jun 26 02:52:09.215282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:52:09.234277 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.236348 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.262464 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.265163 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.294396 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.299287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.439703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:09.439906 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:09.440133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:09.440561 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:09.440702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:09.440843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e6526767-3d97-405a-b57c-0d03d3906e7b req-1996905f-fb11-41d3-bb84-2af729b0807a service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:09.513841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.536668 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999740957000085 future=<Future at 0x72e27c1e5820 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:09.536919 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999464001999968 future=<Future at 0x72e27c1e5820 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:09.537024 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99935266500006 future=<Future at 0x72e27c1e5820 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:09.539296 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Instance destroyed successfully.
Jun 26 02:52:09.540744 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lazy-loading 'resources' on Instance uuid 89077a65-79ce-406a-9fca-bcbac51a89ba {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:09.552674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.554711 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.579855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.844418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.918743 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.952747 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:09.958010 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.043308 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-391180148',display_name='tempest-TestServerVolumeAttachmentScenario-server-391180148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachmentscenario-server-391180148',id=54,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC51CyIcFEGDiRsMcjFpR9lmO6HxUTshd1FX10B2d28YBVqGCxOfUVH2kGPpmAmplIMM7qGsb/noipKiScSnDw/oYr1ZQam+ifr3t1hzTDWxZz5FWdzscFDJHeQLG2o+jg==',key_name='tempest-keypair-1115511862',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:50:54Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d9d0803e00c49998563cf202a69ab1c',ramdisk_id='',reservation_id='r-g2s8d0o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1484440150',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1484440150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='389a3af6a1da43a1ae34023f109f7e77',uuid=89077a65-79ce-406a-9fca-bcbac51a89ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:52:10.043686 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converting VIF {"id": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "address": "fa:16:3e:58:ad:7f", "network": {"id": "fdb294c5-79ef-40d5-943b-c586c61e9386", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-220895450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d9d0803e00c49998563cf202a69ab1c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d6c16e0-1f", "ovs_interfaceid": "2d6c16e0-1ffb-49ce-a757-75d545befceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:10.044361 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:10.046689 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:52:10.047836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.047836 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d6c16e0-1f, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:10.048925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.049906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44e2372f-094d-4b88-8695-d459be0778d7) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:10.054513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.056020 np0000003683 nova-compute[98991]: INFO os_vif [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ad:7f,bridge_name='br-int',has_traffic_filtering=True,id=2d6c16e0-1ffb-49ce-a757-75d545befceb,network=Network(fdb294c5-79ef-40d5-943b-c586c61e9386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d6c16e0-1f')
Jun 26 02:52:10.056467 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Deleting instance files /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba_del
Jun 26 02:52:10.057548 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Deletion of /opt/stack/data/nova/instances/89077a65-79ce-406a-9fca-bcbac51a89ba_del complete
Jun 26 02:52:10.084433 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.088174 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.114900 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:10.564053 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 26 02:52:10.564706 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:52:10.565032 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:52:10.565157 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:52:10.565444 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:10.678197 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:10.769627 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:11.526947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.527979 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:11.528178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:11.528419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:11.528545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:11.528715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:11.528850 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.529034 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:11.529188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:11.529359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:11.529912 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:11.530552 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received unexpected event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with vm_state active and task_state deleting.
Jun 26 02:52:11.530552 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.530552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:11.530552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:11.530552 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:11.530836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:11.530836 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received unexpected event network-vif-plugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with vm_state active and task_state deleting.
Jun 26 02:52:11.530910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.530997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:11.531112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:11.531220 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:11.531317 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:11.531414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:11.531490 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.531608 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Acquiring lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:11.531740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:11.531818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:11.531910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] No waiting events found dispatching network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:11.531992 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-73ae31dd-b62d-49a1-89f6-51b413d39053 req-099e125d-523d-4db9-afbf-4fcc1b5d3085 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-unplugged-2d6c16e0-1ffb-49ce-a757-75d545befceb for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:11.652664 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c8b6fc06-642b-41fa-a74a-8c5731bc3ec6 req-5240fd50-ac76-4144-82aa-cc19dbcf0206 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Received event network-vif-deleted-2d6c16e0-1ffb-49ce-a757-75d545befceb {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:11.653156 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-c8b6fc06-642b-41fa-a74a-8c5731bc3ec6 req-5240fd50-ac76-4144-82aa-cc19dbcf0206 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Neutron deleted interface 2d6c16e0-1ffb-49ce-a757-75d545befceb; detaching it from the instance and deleting it from the info cache
Jun 26 02:52:11.658247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c8b6fc06-642b-41fa-a74a-8c5731bc3ec6 req-5240fd50-ac76-4144-82aa-cc19dbcf0206 service nova] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Detach interface failed, port_id=2d6c16e0-1ffb-49ce-a757-75d545befceb, reason: Instance 89077a65-79ce-406a-9fca-bcbac51a89ba could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:52:11.915727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:12.085866 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:12.106543 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:12.588462 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Took 2.02 seconds to deallocate network for instance.
Jun 26 02:52:12.723059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:13.097434 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:13.098038 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:13.248179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:13.248393 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:13.750858 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:14.257642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:14.317209 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Deleted allocations for instance 89077a65-79ce-406a-9fca-bcbac51a89ba
Jun 26 02:52:15.054195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:15.326265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-af9c5d22-78ad-4b88-b944-006cc99d56a8 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Lock "89077a65-79ce-406a-9fca-bcbac51a89ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.617s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:16.600048 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:16.919017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:17.106872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:19.390446 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:20.018765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:20.054698 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:22.232779 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:22.263781 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:22.335356 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:22.530999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:24.238875 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:24.537109 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0006955249996281054 future=<Future at 0x72e27c1e5820 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:24.537873 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Emitting event <LifecycleEvent: 1782442329.5363238, 89077a65-79ce-406a-9fca-bcbac51a89ba => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:24.538059 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:24.538222 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] VM Stopped (Lifecycle Event)
Jun 26 02:52:24.569721 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:25.041677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e92a4df1-1f25-4de3-9b4a-45b5b9f6ce59 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 89077a65-79ce-406a-9fca-bcbac51a89ba] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:25.056280 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:25.429693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:25.429693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:25.932691 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lazy-loading 'flavor' on Instance uuid 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:26.645631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:26.937685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:27.237961 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:28.186538 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:28.186538 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:28.186538 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Attaching volume fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 to /dev/vdb
Jun 26 02:52:28.231869 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:28.245121 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:52:28.273956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:28.325786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:52:28.326357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:52:28.338204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:52:28.339301 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] 
Jun 26 02:52:28.339454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:52:28.339609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:52:28.339885 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:28.340766 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updating existing volume attachment record: c18c7e34-cbe3-4afd-b7fd-8986ee979771 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:52:28.785022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:28.785334 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:28.905615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:52:28.905815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:28.905815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:28.906462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:28.906775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:52:28.919380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:28.921878 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:28.922318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:28.922563 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:52:28.923298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:28.923889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:28.924084 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:52:28.937730 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:52:28.937730 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:28.945579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:52:28.945579 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334] added
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:28.957189 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:28.957623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:52:28.957807 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:52:28.958078 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334] added
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:28.961015 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:28.961301 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:52:28.961498 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:52:28.961717 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:52:29.288597 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:52:29.871215 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:29.872433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:29.875853 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:52:29.875853 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Claim successful on node np0000003683
Jun 26 02:52:29.958720 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:52:29.962143 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:52:29.972308 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:52:29.979112 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:29.988759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:29.997991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:30.007094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.007094 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:30.007094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.007094 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:30.015438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.015438 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:30.015939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.015939 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:30.045775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.40.100,3260]
Jun 26 02:52:30.045775 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.40.100,3260] successful.
Jun 26 02:52:30.045775 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:30.058883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:30.061351 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] HCTL ('8', '-', '-', 0) found on session 148 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:52:30.076504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:52:30.094349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Searching for a device in session 148 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:52:30.094974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:52:30.286782 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:31.049257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.50.100,3260]
Jun 26 02:52:31.049257 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.50.100,3260] successful.
Jun 26 02:52:31.049257 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:31.063082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:31.074253 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:31.074253 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:31.083099 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:31.083829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:31.083829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:52:31.085563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] HCTL ('9', '-', '-', 0) found on session 149 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:52:31.085563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:52:31.102679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Searching for a device in session 149 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:52:31.102679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:52:31.109221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:31.580315 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:31.956362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:52:32.092160 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:32.092585 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:52:32.238451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:32.599426 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:52:32.599684 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:52:32.600059 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:32.600447 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:32.727661 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e067d2b47da4bb1a1457fa0ad72628f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988d5ab3adc04c35abcbeada86625022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:52:32.777164 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:32.975422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799118 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:52:32.975880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.069s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:32.976200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] <== connect_volume: return (4070ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799118', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799118'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:32.976340 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799118', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799118'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:52:32.979451 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lazy-loading 'flavor' on Instance uuid 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:33.102977 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:52:33.183071 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:33.297355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:33.484345 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Attempting to attach volume fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:   <alias name="ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334"/>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:   <serial>fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334</serial>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:52:33.486017 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:52:33.607119 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:52:33.719643 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Successfully created port: b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:52:34.117784 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Booting with volume f12a25be-e0f3-4e2b-b8f2-4744459a3903 at /dev/vda
Jun 26 02:52:34.176203 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:34.193320 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:52:34.223319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:34.281288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:52:34.281288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:52:34.292057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:52:34.293058 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] 
Jun 26 02:52:34.293231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:52:34.293353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:52:34.293685 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:34.293899 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating existing volume attachment record: 4c67e38b-ff30-4d28-aa35-c52729d61426 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:52:34.778791 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Successfully updated port: b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:52:34.832985 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-changed-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:34.833346 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing instance network info cache due to event network-changed-b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:34.833500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:34.833737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:34.833737 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing network info cache for port b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:34.844772 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:35.064287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:35.187494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:35.187868 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:35.187868 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:35.187868 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] No VIF found with MAC fa:16:3e:b3:3a:57, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:35.279054 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:35.338285 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:35.413300 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:35.565917 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:36.067839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba9a0d17-2157-42ea-94a7-1204476fffe6 req-493623df-767e-4005-b0c9-08f5e509ba26 service nova] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:36.068188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:36.068882 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:52:36.454257 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:52:36.455377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:52:36.455708 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating image(s)
Jun 26 02:52:36.455962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:52:36.456174 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Ensure instance console log exists: /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:52:36.456456 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:36.456799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:36.456973 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:36.640287 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:36.755329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c469506c-7f02-4679-8da8-5f0488d478fb tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.571s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:36.809361 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:36.978864 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:37.246169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:37.248258 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:37.318176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:37.480733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:37.481121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance network_info: |[{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:52:37.481692 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start _get_guest_xml network_info=[{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4c67e38b-ff30-4d28-aa35-c52729d61426', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294', 'attached_at': '', 'detached_at': '', 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'serial': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:52:37.485619 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:37.487001 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1995686116', uuid='2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294'), owner=OwnerMeta(userid='5e067d2b47da4bb1a1457fa0ad72628f', username='tempest-TestShelveInstance-816092709-project-member', projectid='988d5ab3adc04c35abcbeada86625022', projectname='tempest-TestShelveInstance-816092709'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442357.4866345) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:52:37.490116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:52:37.490499 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:52:37.493070 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:52:37.493288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:52:37.494441 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:52:37.496785 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:52:37.496980 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:52:37.497103 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:52:37.497272 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:52:37.497405 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:52:37.497536 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:52:37.497735 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:52:37.497864 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:52:37.498003 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:52:37.498154 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:52:37.498291 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:52:37.516680 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:52:37.517027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:37.517209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:37.517634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:37.517913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:52:37.526500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:37.526714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:37.531215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:37.531773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:37.532248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:37.532467 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:52:37.532781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:37.532933 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:52:37.544461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:52:37.544461 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:37.551270 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:52:37.551270 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903] added
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:37.559623 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:37.559851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:52:37.560584 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:52:37.561397 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903] added
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:52:37.564870 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:37.565082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:52:37.565384 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:52:37.567348 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:52:38.029339 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Detaching volume fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334
Jun 26 02:52:38.071878 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Attempting to driver detach volume fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 from mountpoint /dev/vdb
Jun 26 02:52:38.078118 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Found disk vdb by alias ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:52:38.079539 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Found disk vdb by alias ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Attempting to detach device vdb from instance 1c9a1187-f037-466d-a024-edd1c1387e64 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <alias name="ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334"/>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <serial>fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334</serial>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:52:38.080215 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:52:38.087322 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Successfully detached device vdb from instance 1c9a1187-f037-466d-a024-edd1c1387e64 from the persistent domain config.
Jun 26 02:52:38.087643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] (1/8): Attempting to detach device vdb with device alias ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 from instance 1c9a1187-f037-466d-a024-edd1c1387e64 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <alias name="ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334"/>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <serial>fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334</serial>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:52:38.088796 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:52:38.561333 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:52:38.566510 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:52:38.576093 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:52:38.585014 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.593855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.599366 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.608053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.608053 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.608053 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:38.608309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.608309 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.608309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:38.614308 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.614308 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.614308 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:38.614514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.614514 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.614514 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:38.646256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260]
Jun 26 02:52:38.646256 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260] successful.
Jun 26 02:52:38.646256 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.661549 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442358.6611545, 1c9a1187-f037-466d-a024-edd1c1387e64 => ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:52:38.662692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.665042 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 for instance 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:52:38.667950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260]
Jun 26 02:52:38.667950 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260] successful.
Jun 26 02:52:38.667950 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.672645 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Successfully detached device vdb from instance 1c9a1187-f037-466d-a024-edd1c1387e64 from the live domain config.
Jun 26 02:52:38.674345 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:52:38.674665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:52:38.674823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:52:38.680015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.680015 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.680015 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.680015 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.680015 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:38.680259 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.680259 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.680259 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.680259 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.680259 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:38.680548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:38.680692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:52:38.681425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] HCTL ('7', '-', '-', 0) found on session 150 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:52:38.681592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:52:38.688878 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:38.701473 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching for a device in session 150 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:52:38.701738 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:52:38.705203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.705203 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.705203 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.705203 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.705203 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:38.705432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.705432 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:38.705432 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.705432 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:38.705432 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:38.705727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:38.705895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:52:38.707712 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] HCTL ('10', '-', '-', 0) found on session 151 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:52:38.707828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:52:38.726505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching for a device in session 151 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:52:38.726817 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:52:38.784433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:38.784663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:38.954221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:39.151461 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:39.151715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:39.151924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:39.152069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:39.152224 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:39.152349 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-95f2f5de-3109-40a1-b45a-6c196f6cd09c req-a6c5f296-bdff-4605-b55f-738d9087a47c service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received unexpected event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with vm_state building and task_state spawning.
Jun 26 02:52:39.287012 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:52:39.533471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:52:39.717755 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:39.831618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:39.831835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:39.835034 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:52:39.835198 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Claim successful on node np0000003683
Jun 26 02:52:40.077626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:40.550387 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Found WWN 33000000053038c57 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:52:40.550710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:40.550912 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '33000000053038c57', 'path': '/dev/dm-1', 'multipath_id': '33000000053038c57'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:40.551226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053038c57', 'path': '/dev/dm-1', 'multipath_id': '33000000053038c57'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:52:40.551802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.877s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:52:40.552073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:52:40.552211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:52:40.576898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:40.576898 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:40.576898 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:40.576898 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:40.576898 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:52:40.577088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:40.577088 np0000003683 nova-compute[98991]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash)
Jun 26 02:52:40.577088 np0000003683 nova-compute[98991]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:40.577088 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:52:40.577088 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:52:40.577296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '151')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:52:40.577296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '148')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:40.578017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '149')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:52:40.579276 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c34e200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:52:40.579441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Removing multipathed devices sdd, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:52:40.579681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Flush multipath device 3300000009919a5a7 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:52:40.618633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:40.678372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:52:40.724623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:52:40.724973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:52:40.725633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:52:40.738113 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:52:40.738305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:52:40.749414 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.787379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.40.100,3260]
Jun 26 02:52:40.787379 np0000003683 nova-compute[98991]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.40.100,3260] successful.
Jun 26 02:52:40.787379 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.800026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.811925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.845389 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.50.100,3260]
Jun 26 02:52:40.845389 np0000003683 nova-compute[98991]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334, portal: 192.168.50.100,3260] successful.
Jun 26 02:52:40.845389 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.857843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:52:40.857982 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:52:40.858085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] <== disconnect_volume: return (2183ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:52:40.858231 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:52:41.058759 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm0ZDrs8Zw8sSSdJASOXnbEcwznd5W02ax34C1E1I0VPEpJSnoLmlusI+l+dRaSbzCrwpvGWwC+mjdRSAFE6gtTqBVwUXUofC5tSUpniGj3B/xEovZbiePKWMjCs9v55Q==',key_name='tempest-TestShelveInstance-113486237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:34Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:52:41.058947 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:41.059621 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:41.060327 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:41.061856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:41.062046 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:41.111062 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:41.111320 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:41.407328 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lazy-loading 'flavor' on Instance uuid 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <uuid>2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</uuid>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <name>instance-0000003a</name>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestShelveInstance-server-1995686116</nova:name>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:52:37</nova:creationTime>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:user uuid="5e067d2b47da4bb1a1457fa0ad72628f">tempest-TestShelveInstance-816092709-project-member</nova:user>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:project uuid="988d5ab3adc04c35abcbeada86625022">tempest-TestShelveInstance-816092709</nova:project>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         <nova:port uuid="b7b999a4-0155-4154-9107-2c63992903ec">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="serial">2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="uuid">2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <alias name="ua-f12a25be-e0f3-4e2b-b8f2-4744459a3903"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <serial>f12a25be-e0f3-4e2b-b8f2-4744459a3903</serial>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b6:73:a3"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <target dev="tapb7b999a4-01"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/console.log" append="off"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:52:41.564531 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:52:41.567869 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:41.571460 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Preparing to wait for external event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:52:41.571675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:41.571794 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:41.571989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:41.572775 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm0ZDrs8Zw8sSSdJASOXnbEcwznd5W02ax34C1E1I0VPEpJSnoLmlusI+l+dRaSbzCrwpvGWwC+mjdRSAFE6gtTqBVwUXUofC5tSUpniGj3B/xEovZbiePKWMjCs9v55Q==',key_name='tempest-TestShelveInstance-113486237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:34Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:52:41.573051 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:41.573584 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:41.573889 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:52:41.574642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.575606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:41.575606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:52:41.575879 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.576088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0b66546-8774-53c3-9c47-0839f8e0d9d2', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:41.576884 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.577739 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:41.579856 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.580045 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b999a4-01, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:41.581005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7b999a4-01, col_values=(('qos', UUID('dd35656a-026b-4976-b49f-6cba0031fa90')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:41.581005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7b999a4-01, col_values=(('external_ids', {'iface-id': 'b7b999a4-0155-4154-9107-2c63992903ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:73:a3', 'vm-uuid': '2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:41.581786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.582842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:41.587460 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:41.588020 np0000003683 nova-compute[98991]: INFO os_vif [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01')
Jun 26 02:52:41.612907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:52:42.076810 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.245s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:42.077373 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:52:42.171426 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:42.171636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:42.176495 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:52:42.176649 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Claim successful on node np0000003683
Jun 26 02:52:42.253080 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:42.412416 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9c9b16e3-c0d3-4712-8394-7d23e8292727 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.886s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:42.583545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:52:42.583742 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:52:42.584577 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:42.584830 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:42.651069 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02816c16bbcd47f5a1d15ca6d6377e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0501274670f84685b7449e324b329eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:52:42.770353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:42.770622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:43.087762 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:52:43.104062 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:43.104062 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:43.104062 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No VIF found with MAC fa:16:3e:b6:73:a3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:43.110119 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Using config drive
Jun 26 02:52:43.189735 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Successfully created port: d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:52:43.274220 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:52:43.451267 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:43.451417 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:43.590809 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:52:43.610295 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:43.688166 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Successfully updated port: d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:52:43.733196 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating config drive at /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config
Jun 26 02:52:43.736338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbtwnp42c {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:43.759307 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:43.759558 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing instance network info cache due to event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:43.759915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] Acquiring lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:43.760047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] Acquired lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:43.760246 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing network info cache for port d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:43.794984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbtwnp42c" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:43.825738 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:43.954218 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:44.105856 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.106329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.106329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.106428 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.106614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:44.108589 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Terminating instance
Jun 26 02:52:44.129927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.130111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.190173 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:44.200624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.232616 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.235052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.264208 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:44.309034 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.324791 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:44.455368 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:44.461860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.290s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:44.463098 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.637s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.463794 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:52:44.468899 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:52:44.471314 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Claim successful on node np0000003683
Jun 26 02:52:44.504009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.505835 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.507712 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.532945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.599312 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:52:44.600655 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:52:44.600970 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Creating image(s)
Jun 26 02:52:44.601595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.601803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.602331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:44.603083 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:44.606901 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:44.609579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:44.627758 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:52:44.632862 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:52:44.667979 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.672876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.694622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.706750 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.727548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.118s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:44.728026 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.728589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.729117 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:44.732814 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:44.733247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:44.749432 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:44.830375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:44.830847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:44.864830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:44.864830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:44.864830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:44.864830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:44.864830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] No waiting events found dispatching network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:44.865297 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-60943e77-6673-4ae5-84d6-7a4e16253fae req-60731273-7fc2-40d8-b744-31be50a100f7 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:44.898066 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk 1073741824" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:44.898305 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:44.898793 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:44.958052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f909ad4f-545d-4d82-9ccf-4677c293c581 req-63caae47-785d-4609-bfc6-91e50666538b service nova] Releasing lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:44.958999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquired lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:44.959352 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:52:44.970990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:52:44.971303 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:52:44.972021 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:44.972491 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:44.981246 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999636582999756 future=<Future at 0x72e29c21b1d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:44.981666 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999213274999875 future=<Future at 0x72e29c21b1d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:44.981993 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999054088999856 future=<Future at 0x72e29c21b1d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:44.985112 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Instance destroyed successfully.
Jun 26 02:52:44.985752 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lazy-loading 'resources' on Instance uuid 1c9a1187-f037-466d-a024-edd1c1387e64 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:45.016356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:45.017057 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:52:45.017057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:45.049269 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442365.0477834, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:45.050120 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Started (Lifecycle Event)
Jun 26 02:52:45.087293 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '977d9a5f3eb44dedb8603e2c29fd3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7628b1959b0f48c8bc85aa076fa6ea71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:52:45.107955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:45.108838 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Cannot resize image /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:52:45.108838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:52:45.108838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Ensure instance console log exists: /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:52:45.108988 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:45.109228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:45.109346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:45.193527 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:45.482435 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:52:45.488443 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2132748191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testservervolumeattachscenariooldversion-server-2132748',id=57,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw/KkyeFr5g4BFxBD9XMai4SaLaajAqleJ8hDbZmERHuRM2NiQJMfyrluTQ/85o3/q5jTABDAEtGbNthXRxMMiGJxJPXWZsp5c/FC5b5zf5x5XAD8/vTVE93+AhvRruSg==',key_name='tempest-keypair-2090029325',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:51:45Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113949dbf75c4f588d00edb88ac841e3',ramdisk_id='',reservation_id='r-lfdcogq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:51:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9cfcb756f384dbdaaa22c52c213f9ce',uuid=1c9a1187-f037-466d-a024-edd1c1387e64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:52:45.488698 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converting VIF {"id": "43602d6d-8505-44e4-925a-5078e49dc0b2", "address": "fa:16:3e:b3:3a:57", "network": {"id": "86a62f92-d57a-42af-b0a3-421cbf613243", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-563118268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "113949dbf75c4f588d00edb88ac841e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43602d6d-85", "ovs_interfaceid": "43602d6d-8505-44e4-925a-5078e49dc0b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:45.489374 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:45.489664 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:52:45.492852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:45.492852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43602d6d-85, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:45.494183 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:45.497779 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Successfully created port: 3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:52:45.499953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:45.500967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:45.501269 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd4590de-debf-4a01-a82d-a3461cf7c4bb) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:45.503354 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:45.505423 np0000003683 nova-compute[98991]: INFO os_vif [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=43602d6d-8505-44e4-925a-5078e49dc0b2,network=Network(86a62f92-d57a-42af-b0a3-421cbf613243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43602d6d-85')
Jun 26 02:52:45.505731 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Deleting instance files /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64_del
Jun 26 02:52:45.506843 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Deletion of /opt/stack/data/nova/instances/1c9a1187-f037-466d-a024-edd1c1387e64_del complete
Jun 26 02:52:45.526264 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:45.558063 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:45.560093 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442365.55989, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:45.560221 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Paused (Lifecycle Event)
Jun 26 02:52:45.723012 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:45.833722 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:45.833914 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:45.876645 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating instance_info_cache with network_info: [{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:45.985871 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:52:46.013493 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:52:46.014304 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:52:46.014676 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:52:46.014814 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:52:46.015003 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:46.062175 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:46.064715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:46.138120 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:46.336683 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:46.378791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Releasing lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:46.378791 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance network_info: |[{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:52:46.381728 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Start _get_guest_xml network_info=[{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:52:46.389050 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:46.390396 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1008281534', uuid='fbed1f7d-1080-4781-aaca-03b672cb4168'), owner=OwnerMeta(userid='02816c16bbcd47f5a1d15ca6d6377e09', username='tempest-TestStampPattern-1659297009-project-member', projectid='0501274670f84685b7449e324b329eb8', projectname='tempest-TestStampPattern-1659297009'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442366.389916) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:52:46.391769 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:52:46.392020 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:52:46.392991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:52:46.393178 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:52:46.394122 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:52:46.394426 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:52:46.394578 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:52:46.394663 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:52:46.394781 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:52:46.394856 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:52:46.394941 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:52:46.395082 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:52:46.395185 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:52:46.395287 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:52:46.395382 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:52:46.395506 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:52:46.405415 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008281534',display_name='tempest-TestStampPattern-server-1008281534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-1008281534',id=59,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-ktozx8ao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:44Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=fbed1f7d-1080-4781-aaca-03b672cb4168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:52:46.405612 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:46.406269 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:46.406862 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'pci_devices' on Instance uuid fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:46.429909 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Successfully updated port: 3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:52:46.481472 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-changed-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:46.481673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Refreshing instance network info cache due to event network-changed-3b8c868f-98d8-4470-9066-1b70011ee38d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:46.482646 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] Acquiring lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:46.482646 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] Acquired lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:46.482646 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Refreshing network info cache for port 3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:46.567176 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:46.616715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5255fe5b-3bcd-46ea-b6c6-921c319248d0 req-77281dd7-ad5e-487d-bfa3-8dd239f329c4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-deleted-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:46.616781 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-5255fe5b-3bcd-46ea-b6c6-921c319248d0 req-77281dd7-ad5e-487d-bfa3-8dd239f329c4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Neutron deleted interface 43602d6d-8505-44e4-925a-5078e49dc0b2; detaching it from the instance and deleting it from the info cache
Jun 26 02:52:46.618690 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5255fe5b-3bcd-46ea-b6c6-921c319248d0 req-77281dd7-ad5e-487d-bfa3-8dd239f329c4 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Detach interface failed, port_id=43602d6d-8505-44e4-925a-5078e49dc0b2, reason: Instance 1c9a1187-f037-466d-a024-edd1c1387e64 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:52:46.846012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.384s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:46.846418 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:52:46.848636 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.655s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:46.852059 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:52:46.852205 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Claim successful on node np0000003683
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <uuid>fbed1f7d-1080-4781-aaca-03b672cb4168</uuid>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <name>instance-0000003b</name>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestStampPattern-server-1008281534</nova:name>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:52:46</nova:creationTime>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:user uuid="02816c16bbcd47f5a1d15ca6d6377e09">tempest-TestStampPattern-1659297009-project-member</nova:user>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:project uuid="0501274670f84685b7449e324b329eb8">tempest-TestStampPattern-1659297009</nova:project>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         <nova:port uuid="d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="serial">fbed1f7d-1080-4781-aaca-03b672cb4168</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="uuid">fbed1f7d-1080-4781-aaca-03b672cb4168</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.config"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1b:47:8e"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <target dev="tapd3024e90-af"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/console.log" append="off"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:52:46.910859 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Preparing to wait for external event network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008281534',display_name='tempest-TestStampPattern-server-1008281534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-1008281534',id=59,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-ktozx8ao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:44Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=fbed1f7d-1080-4781-aaca-03b672cb4168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:52:46.912770 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:46.913241 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:46.913469 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:52:46.913923 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.914421 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:46.914683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:52:46.915275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.915489 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cb5698c-42cb-5c3a-98f4-bd133d16f120', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:46.916222 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.916883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:46.917112 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.918909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.919079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3024e90-af, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:46.919419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3024e90-af, col_values=(('qos', UUID('8987ff97-e2a9-4aff-a637-8c76676de28c')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:46.919626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3024e90-af, col_values=(('external_ids', {'iface-id': 'd3024e90-af0b-4de2-aa2d-4f0c2eff0ad0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:47:8e', 'vm-uuid': 'fbed1f7d-1080-4781-aaca-03b672cb4168'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:46.920350 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.921392 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:46.925940 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:46.927067 np0000003683 nova-compute[98991]: INFO os_vif [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af')
Jun 26 02:52:46.930764 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:46.931345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] Acquiring lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:46.931555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:46.931696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] Lock "1c9a1187-f037-466d-a024-edd1c1387e64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:46.931835 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] No waiting events found dispatching network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:46.931959 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f39f6f5-a7cb-4dc3-a914-a0e663f89aa2 req-d57caba7-c8e7-41f9-84ce-e7bab05f1194 service nova] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Received event network-vif-unplugged-43602d6d-8505-44e4-925a-5078e49dc0b2 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:52:46.932648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:46.984365 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:46.995064 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:52:46.995991 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:52:46.996250 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Creating image(s)
Jun 26 02:52:46.996691 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:46.996893 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:46.997350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:46.997912 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:47.000283 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:47.001079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:47.055697 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:47.073179 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:47.086342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:47.086855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:47.087379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:47.088052 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:47.091434 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:47.091803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:47.178558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:47.179063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:47.195959 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:47.238057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk 1073741824" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:47.238446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:47.238842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:47.255190 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:47.324053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:47.324538 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:52:47.324790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:47.357192 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:52:47.357524 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:52:47.359301 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:47.359801 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:47.414612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:47.414950 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Cannot resize image /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:52:47.415280 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:52:47.415433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Ensure instance console log exists: /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:52:47.415743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:47.415909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:47.416040 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:47.438170 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145815cb362e40ad95db2c64431821bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87599dd62cac4c0d9bfad984dc67bf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:52:47.575842 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Took 1.56 seconds to deallocate network for instance.
Jun 26 02:52:47.699319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0e84112e-027f-4b7a-8ea0-41b577cd042c req-ec72ba3d-f980-4591-96f7-94db12720525 service nova] Releasing lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:47.699875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquired lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:47.700023 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:52:47.864810 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:52:47.884922 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Successfully created port: 07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:52:48.082792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:48.169439 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:48.169681 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:48.258818 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:48.368088 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:52:48.399644 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:48.450324 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:48.450493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:48.450611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No VIF found with MAC fa:16:3e:1b:47:8e, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:48.451134 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Using config drive
Jun 26 02:52:48.513846 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Successfully updated port: 07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:52:48.534622 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Updating instance_info_cache with network_info: [{"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:48.555004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:48.555004 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:48.555101 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:48.555285 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:48.555589 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] No event matching network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 in dict_keys([('network-vif-plugged', 'd3024e90-af0b-4de2-aa2d-4f0c2eff0ad0')]) {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 26 02:52:48.556079 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received unexpected event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 for instance with vm_state building and task_state spawning.
Jun 26 02:52:48.556338 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:48.556389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:48.556828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:48.556828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Processing event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:48.557733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:48.558197 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received unexpected event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with vm_state building and task_state spawning.
Jun 26 02:52:48.558412 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:48.558582 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:48.558742 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:48.558875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:48.559008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] No waiting events found dispatching network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:48.559803 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3d8e2eed-be15-4a45-836e-e742135d287c req-032a4791-1fe9-40b4-b865-b0ce3705d3e5 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received unexpected event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d for instance with vm_state building and task_state spawning.
Jun 26 02:52:48.560577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:52:48.564779 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442368.5643291, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:48.565900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:52:48.566354 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Resumed (Lifecycle Event)
Jun 26 02:52:48.570038 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance spawned successfully.
Jun 26 02:52:48.570434 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:52:48.573171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:48.573289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing instance network info cache due to event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:48.573504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] Acquiring lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:48.573590 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] Acquired lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:48.574454 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing network info cache for port 07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:48.673509 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:48.958263 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:49.015834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:49.041467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Releasing lock "refresh_cache-0ff63aa2-8b2d-42e2-b26a-1025252444a2" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:49.041801 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance network_info: |[{"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:52:49.044250 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Start _get_guest_xml network_info=[{"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:52:49.047155 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:49.048368 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1134210972', uuid='0ff63aa2-8b2d-42e2-b26a-1025252444a2'), owner=OwnerMeta(userid='977d9a5f3eb44dedb8603e2c29fd3290', username='tempest-VolumesActionsTest-217415062-project-member', projectid='7628b1959b0f48c8bc85aa076fa6ea71', projectname='tempest-VolumesActionsTest-217415062'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442369.0479527) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:52:49.049502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:52:49.049836 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:52:49.051050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:52:49.051274 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:52:49.052264 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:52:49.052677 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:52:49.052878 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:52:49.052962 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:52:49.053113 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:52:49.053298 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:52:49.053346 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:52:49.053507 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:52:49.053646 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:52:49.053726 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:52:49.053815 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:52:49.053919 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:52:49.064440 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134210972',display_name='tempest-VolumesActionsTest-instance-1134210972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-1134210972',id=60,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7628b1959b0f48c8bc85aa076fa6ea71',ramdisk_id='',reservation_id='r-l5telklq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-217415062',owner_user_name='tempest-VolumesActionsTest-217415062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:46Z,user_data=None,user_id='977d9a5f3eb44dedb8603e2c29fd3290',uuid=0ff63aa2-8b2d-42e2-b26a-1025252444a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:52:49.064665 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converting VIF {"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:49.065320 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:49.065912 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ff63aa2-8b2d-42e2-b26a-1025252444a2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:49.070349 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:49.075516 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:49.077971 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:49.081985 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.082574 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.083017 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.083381 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.083704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.083913 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:49.106676 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Creating config drive at /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.config
Jun 26 02:52:49.113531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphytuj7nd {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.178091 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphytuj7nd" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.181337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.333s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:49.182213 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:52:49.186642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.104s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:49.190500 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:49.376151 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:49.377957 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:52:49.380525 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:52:49.380792 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Creating image(s)
Jun 26 02:52:49.381358 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:49.381579 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:49.382273 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:49.382869 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:49.387268 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:49.388822 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.484070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.484467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:49.484931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:49.485397 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:49.489441 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:49.489858 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <uuid>0ff63aa2-8b2d-42e2-b26a-1025252444a2</uuid>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <name>instance-0000003c</name>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesActionsTest-instance-1134210972</nova:name>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:52:49</nova:creationTime>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:user uuid="977d9a5f3eb44dedb8603e2c29fd3290">tempest-VolumesActionsTest-217415062-project-member</nova:user>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:project uuid="7628b1959b0f48c8bc85aa076fa6ea71">tempest-VolumesActionsTest-217415062</nova:project>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         <nova:port uuid="3b8c868f-98d8-4470-9066-1b70011ee38d">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="serial">0ff63aa2-8b2d-42e2-b26a-1025252444a2</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="uuid">0ff63aa2-8b2d-42e2-b26a-1025252444a2</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.config"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:63:3f:8f"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <target dev="tap3b8c868f-98"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/console.log" append="off"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:52:49.569760 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Preparing to wait for external event network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134210972',display_name='tempest-VolumesActionsTest-instance-1134210972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-1134210972',id=60,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7628b1959b0f48c8bc85aa076fa6ea71',ramdisk_id='',reservation_id='r-l5telklq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-217415062',owner_user_name='tempest-VolumesActionsTest-217415062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:46Z,user_data=None,user_id='977d9a5f3eb44dedb8603e2c29fd3290',uuid=0ff63aa2-8b2d-42e2-b26a-1025252444a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converting VIF {"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:49.573085 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:52:49.574221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.574221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:49.574221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:52:49.574828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.574975 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f55d883-b4e4-5445-ac95-c38ab272b87b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:49.575773 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.576849 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:49.582294 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:49.582632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.584914 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.585143 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b8c868f-98, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:49.585584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b8c868f-98, col_values=(('qos', UUID('a30fdd47-8643-4a0a-bc59-c49858d6ef77')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:49.585761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b8c868f-98, col_values=(('external_ids', {'iface-id': '3b8c868f-98d8-4470-9066-1b70011ee38d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:3f:8f', 'vm-uuid': '0ff63aa2-8b2d-42e2-b26a-1025252444a2'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:49.586760 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.588214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:49.589917 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Took 13.14 seconds to spawn the instance on the hypervisor.
Jun 26 02:52:49.590073 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:49.598766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.600077 np0000003683 nova-compute[98991]: INFO os_vif [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98')
Jun 26 02:52:49.607201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.607674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.635676 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.670378 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.679179 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:49.679179 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:49.682457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk 1073741824" returned: 0 in 0.075s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.682998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:49.682998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.711052 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:52:49.711365 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:52:49.712199 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:49.712677 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:49.761057 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.800987 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.800987 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:52:49.801093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:49.834564 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f08f0507eec40189b858129b4cc7fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05f689c58a04254b3930f0cc279148c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:52:49.881521 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1c9a6293-9459-4db2-82d7-a8b562ea53bd req-32e31882-e3f6-4ef1-bf3d-9f93980b11b9 service nova] Releasing lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:49.883335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquired lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:49.883557 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:52:49.919780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:49.920038 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Cannot resize image /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:52:49.920495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:52:49.923016 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Ensure instance console log exists: /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:52:49.923016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:49.923016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:49.923016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:49.986607 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.992561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:49.994786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:50.031759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:50.042863 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:50.107699 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Took 20.31 seconds to build instance.
Jun 26 02:52:50.183764 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:50.218420 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:52:50.410495 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Successfully created port: 7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:52:50.472896 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:50.505024 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442370.5046713, fbed1f7d-1080-4781-aaca-03b672cb4168 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:50.505246 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] VM Started (Lifecycle Event)
Jun 26 02:52:50.611063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.826s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Processing event network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] No waiting events found dispatching network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:50.626564 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-61e8bd78-a2a1-4c56-8b0f-d63e573bab48 req-a7771040-ad88-475d-b924-d701f3938965 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received unexpected event network-vif-plugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 for instance with vm_state building and task_state spawning.
Jun 26 02:52:50.627102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:52:50.633377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:52:50.635906 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance spawned successfully.
Jun 26 02:52:50.636310 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:52:50.683092 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:50.694528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:50.726296 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:52:50.802760 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Deleted allocations for instance 1c9a1187-f037-466d-a024-edd1c1387e64
Jun 26 02:52:50.827228 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating instance_info_cache with network_info: [{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:51.007978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:51.011498 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:51.040872 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Successfully updated port: 7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:52:51.142988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.143101 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.143420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.143665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.143902 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.144195 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:51.159181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:51.159424 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:51.159624 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] No VIF found with MAC fa:16:3e:63:3f:8f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:51.160132 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Using config drive
Jun 26 02:52:51.331267 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Releasing lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:51.331642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance network_info: |[{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:52:51.333672 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Start _get_guest_xml network_info=[{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:52:51.338541 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:51.338541 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-213064390', uuid='a5d387b7-a9ad-4a06-8504-93a902496c23'), owner=OwnerMeta(userid='145815cb362e40ad95db2c64431821bc', username='tempest-VolumeMultiattachTests-190007800-project-member', projectid='87599dd62cac4c0d9bfad984dc67bf67', projectname='tempest-VolumeMultiattachTests-190007800'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442371.3373828) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:52:51.339250 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:52:51.339677 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:52:51.341089 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:52:51.341840 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:52:51.342365 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:52:51.342751 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:52:51.342923 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:52:51.343048 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:52:51.343212 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:52:51.343333 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:52:51.343959 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:52:51.344236 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:52:51.344405 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:52:51.344809 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:52:51.344994 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:52:51.345204 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:52:51.358812 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-213064390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-213064390',id=61,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-4pmsyoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=a5d387b7-a9ad-4a06-8504-93a902496c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:52:51.359071 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:51.359836 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:51.360775 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'pci_devices' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:51.513804 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:51.514279 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442371.5138826, fbed1f7d-1080-4781-aaca-03b672cb4168 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:51.514279 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] VM Paused (Lifecycle Event)
Jun 26 02:52:51.543115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:51.543265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquired lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:51.543677 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:52:51.648617 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Took 7.05 seconds to spawn the instance on the hypervisor.
Jun 26 02:52:51.648773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:51.665879 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:51.730924 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-changed-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:51.731486 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing instance network info cache due to event network-changed-b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:51.731693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:51.731848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:51.732018 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing network info cache for port b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:51.734581 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:52:51.736054 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:52:51.736400 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Creating image(s)
Jun 26 02:52:51.736834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:51.737010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:51.737498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:51.738680 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:51.745749 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:51.748441 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:51.813985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ca415d56-6e10-435d-ad31-151e3e8adb72 tempest-TestServerVolumeAttachScenarioOldVersion-594246316 tempest-TestServerVolumeAttachScenarioOldVersion-594246316-project-member] Lock "1c9a1187-f037-466d-a024-edd1c1387e64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.708s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:51.827157 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Creating config drive at /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.config
Jun 26 02:52:51.832806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu9hqy4qx {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:51.847432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:51.848055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:51.848811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:51.851717 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:51.855317 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:52:51.855828 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <uuid>a5d387b7-a9ad-4a06-8504-93a902496c23</uuid>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <name>instance-0000003d</name>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumeMultiattachTests-server-213064390</nova:name>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:52:51</nova:creationTime>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:user uuid="145815cb362e40ad95db2c64431821bc">tempest-VolumeMultiattachTests-190007800-project-member</nova:user>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:project uuid="87599dd62cac4c0d9bfad984dc67bf67">tempest-VolumeMultiattachTests-190007800</nova:project>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         <nova:port uuid="07d56f48-31a3-4499-9e44-ec684a89c432">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="serial">a5d387b7-a9ad-4a06-8504-93a902496c23</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="uuid">a5d387b7-a9ad-4a06-8504-93a902496c23</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.config"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:2e:ea:a9"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <target dev="tap07d56f48-31"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/console.log" append="off"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:52:51.873820 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:52:51.875804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Preparing to wait for external event network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:52:51.875804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:51.875804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:51.875804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:51.877239 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-213064390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-213064390',id=61,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-4pmsyoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=a5d387b7-a9ad-4a06-8504-93a902496c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:52:51.877620 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:51.878681 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:51.879131 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:52:51.880201 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.880883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:51.881809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:52:51.887271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.887271 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2022239-2f59-5bed-ba73-fd4f79f19a4d', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:51.888829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.888829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:51.894188 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.896941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.896941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07d56f48-31, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:51.897675 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07d56f48-31, col_values=(('qos', UUID('9b165b9a-0b10-4ae6-8aa7-98409a0bb92b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:51.897675 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07d56f48-31, col_values=(('external_ids', {'iface-id': '07d56f48-31a3-4499-9e44-ec684a89c432', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ea:a9', 'vm-uuid': 'a5d387b7-a9ad-4a06-8504-93a902496c23'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:51.899294 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.899672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:51.902176 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu9hqy4qx" returned: 0 in 0.069s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:51.911629 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:51.911629 np0000003683 nova-compute[98991]: INFO os_vif [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31')
Jun 26 02:52:51.949963 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.094s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:51.950399 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:52.017219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:52.021500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk 1073741824" returned: 0 in 0.069s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:52.021500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:52.021500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:52.039469 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442372.038338, fbed1f7d-1080-4781-aaca-03b672cb4168 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:52.039756 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] VM Resumed (Lifecycle Event)
Jun 26 02:52:52.131105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.111s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:52.131342 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:52:52.131606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:52.150677 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:52:52.163624 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Took 12.37 seconds to build instance.
Jun 26 02:52:52.235721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:52.236177 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Cannot resize image /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:52:52.238136 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:52.238452 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:52:52.238891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Ensure instance console log exists: /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:52:52.239415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:52.240675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:52.243218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:52.255771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.344029 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:52.344585 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:52.379215 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:52.379215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.410981 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.510892 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.544600 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:52.550399 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:52.565439 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updating instance_info_cache with network_info: [{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:52.667663 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:52.667663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-9cacd930-016b-4e5e-97db-ea6f479311ee tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.883s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:52.720539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-changed-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:52.720698 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Refreshing instance network info cache due to event network-changed-7a1d3294-4501-4bcd-b52a-c3c45a8792a4. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:52.720832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] Acquiring lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:52.764226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.772110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.776580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.808525 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.814225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:52.860937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:52.861228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:52.861424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:52.861637 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:52:52.864202 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updated VIF entry in instance network info cache for port b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:52:52.865018 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:53.069098 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Releasing lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:53.069429 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Instance network_info: |[{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:52:53.069887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] Acquired lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:53.070109 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Refreshing network info cache for port 7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:53.073087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Start _get_guest_xml network_info=[{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:52:53.079928 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:53.081285 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-984607456', uuid='6a8fd917-0209-4446-b631-a83c282ef124'), owner=OwnerMeta(userid='3f08f0507eec40189b858129b4cc7fd1', username='tempest-VolumesBackupsTest-1738581805-project-member', projectid='c05f689c58a04254b3930f0cc279148c', projectname='tempest-VolumesBackupsTest-1738581805'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442373.0808246) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:52:53.083332 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:52:53.083947 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:52:53.086220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:52:53.086357 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:52:53.087286 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:52:53.087604 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:52:53.087762 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:52:53.087858 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:52:53.088023 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:52:53.088127 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:52:53.088271 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:52:53.088404 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:52:53.088951 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:52:53.089134 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:52:53.089321 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:52:53.089490 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:52:53.109330 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-984607456',display_name='tempest-VolumesBackupsTest-instance-984607456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-984607456',id=62,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIzRul4EHkAdReqfFCDMF+Ofc+hS5rpwOAagJNfBeJscg2vVDVAnzrUINXHofr5urI1TO3pkv2BuNnK0m8jONKO6fd8hiQyZ3ipj04M9tponF9Co/IcWwYqaT/GPRJ5yg==',key_name='tempest-keypair-1691046292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-ga2hke0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=6a8fd917-0209-4446-b631-a83c282ef124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:52:53.109593 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:53.110290 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:53.111403 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:52:53.264172 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442373.2636886, 0ff63aa2-8b2d-42e2-b26a-1025252444a2 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:53.264172 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] VM Started (Lifecycle Event)
Jun 26 02:52:53.369050 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-eafeaf4c-890b-48df-91de-b0af9a966e14 req-89c6ce40-9d3f-4e5d-9ce9-5bcc08e9c8b5 service nova] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:53.435616 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:53.436095 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:53.436095 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:2e:ea:a9, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:53.436278 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Using config drive
Jun 26 02:52:53.574501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <uuid>6a8fd917-0209-4446-b631-a83c282ef124</uuid>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <name>instance-0000003e</name>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumesBackupsTest-instance-984607456</nova:name>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:52:53</nova:creationTime>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:user uuid="3f08f0507eec40189b858129b4cc7fd1">tempest-VolumesBackupsTest-1738581805-project-member</nova:user>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:project uuid="c05f689c58a04254b3930f0cc279148c">tempest-VolumesBackupsTest-1738581805</nova:project>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         <nova:port uuid="7a1d3294-4501-4bcd-b52a-c3c45a8792a4">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="serial">6a8fd917-0209-4446-b631-a83c282ef124</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="uuid">6a8fd917-0209-4446-b631-a83c282ef124</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.config"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:de:7f:47"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <target dev="tap7a1d3294-45"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/console.log" append="off"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:52:53.614994 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:52:53.617932 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Preparing to wait for external event network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:52:53.617932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:53.617932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:53.617932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:53.617932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-984607456',display_name='tempest-VolumesBackupsTest-instance-984607456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-984607456',id=62,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIzRul4EHkAdReqfFCDMF+Ofc+hS5rpwOAagJNfBeJscg2vVDVAnzrUINXHofr5urI1TO3pkv2BuNnK0m8jONKO6fd8hiQyZ3ipj04M9tponF9Co/IcWwYqaT/GPRJ5yg==',key_name='tempest-keypair-1691046292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-ga2hke0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=6a8fd917-0209-4446-b631-a83c282ef124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:52:53.618422 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:52:53.618753 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:52:53.619155 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:52:53.619647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.619961 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:53.620240 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:52:53.621133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.621299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a1c9108-2edd-509f-9cf9-831d15d0fe50', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:53.622371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.623011 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:53.628092 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.634107 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.634410 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a1d3294-45, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:53.634738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a1d3294-45, col_values=(('qos', UUID('0f8b848c-1ba2-41cd-8768-83acf2ec7e07')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:53.634889 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a1d3294-45, col_values=(('external_ids', {'iface-id': '7a1d3294-4501-4bcd-b52a-c3c45a8792a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:7f:47', 'vm-uuid': '6a8fd917-0209-4446-b631-a83c282ef124'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:52:53.635705 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.636803 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:52:53.646160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:53.647365 np0000003683 nova-compute[98991]: INFO os_vif [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45')
Jun 26 02:52:53.768280 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:53.773015 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442373.7727664, 0ff63aa2-8b2d-42e2-b26a-1025252444a2 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:53.773153 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] VM Paused (Lifecycle Event)
Jun 26 02:52:53.900832 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:52:53.903823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:53.937047 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:53.951042 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:54.009036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:54.011497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:54.115370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:54.120268 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:54.180374 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Creating config drive at /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.config
Jun 26 02:52:54.191657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp361enptr {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:54.218746 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updated VIF entry in instance network info cache for port 7a1d3294-4501-4bcd-b52a-c3c45a8792a4. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:52:54.219585 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updating instance_info_cache with network_info: [{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:54.222419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:54.228679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:54.230070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:54.260847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp361enptr" returned: 0 in 0.069s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:54.276298 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:54.288309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:54.355203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:54.637228 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:54.637640 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing instance network info cache due to event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:52:54.637915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] Acquiring lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:52:54.638045 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] Acquired lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:52:54.638226 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing network info cache for port d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:52:54.725867 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-86b54734-8fed-4e5f-a9cf-56835a20d517 req-687b807f-b46a-43bd-847a-1bf41268bf5c service nova] Releasing lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:54.793560 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:54.799991 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:54.805162 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:54.805566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:54.807205 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:54.807205 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:54.807205 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Processing event network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:52:54.807417 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:54.807417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:54.807938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:54.807938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:54.807938 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] No waiting events found dispatching network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:54.808177 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d4ccda19-cf75-4b0c-af63-28ec007a14c5 req-1ca6a2e0-fd6f-4b78-970f-1754c3f7ddf6 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received unexpected event network-vif-plugged-3b8c868f-98d8-4470-9066-1b70011ee38d for instance with vm_state building and task_state spawning.
Jun 26 02:52:54.809027 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:52:54.813882 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442374.8121426, 0ff63aa2-8b2d-42e2-b26a-1025252444a2 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:54.813882 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] VM Resumed (Lifecycle Event)
Jun 26 02:52:54.818441 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:52:54.825438 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance spawned successfully.
Jun 26 02:52:54.825947 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:52:54.844115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:54.850262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:54.933638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:54.975641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:55.099061 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:55.100276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:55.148356 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:55.183457 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:55.183738 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:52:55.183934 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No VIF found with MAC fa:16:3e:de:7f:47, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:52:55.184766 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Using config drive
Jun 26 02:52:55.195363 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:55.202564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:55.205513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:55.208545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:55.218782 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:52:55.218782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:55.242617 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:55.273092 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:55.273546 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51485MB free_disk=72.1325798034668GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:52:55.273690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:55.273890 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:55.320493 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:55.323812 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:55.337366 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.337560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.337891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.338154 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.338470 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.338703 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:55.543697 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:55.699515 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:52:55.703557 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updated VIF entry in instance network info cache for port d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:52:55.703848 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating instance_info_cache with network_info: [{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:52:55.826557 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:55.826878 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442375.8266816, a5d387b7-a9ad-4a06-8504-93a902496c23 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:55.826993 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] VM Started (Lifecycle Event)
Jun 26 02:52:55.842867 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Creating config drive at /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.config
Jun 26 02:52:55.849309 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Took 8.85 seconds to spawn the instance on the hypervisor.
Jun 26 02:52:55.849309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:55.850062 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdsbpg_1j {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:52:55.915072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdsbpg_1j" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:52:56.210022 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-65f8a31c-142a-40f4-9834-b8b0fa09b589 req-782bc1d1-ba4b-4021-bb45-09a64b3274bc service nova] Releasing lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:52:56.330094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:56.341063 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442376.3392465, a5d387b7-a9ad-4a06-8504-93a902496c23 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:56.341063 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] VM Paused (Lifecycle Event)
Jun 26 02:52:56.377846 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:52:56.378014 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbed1f7d-1080-4781-aaca-03b672cb4168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:52:56.378075 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0ff63aa2-8b2d-42e2-b26a-1025252444a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:52:56.378188 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a5d387b7-a9ad-4a06-8504-93a902496c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:52:56.378301 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 6a8fd917-0209-4446-b631-a83c282ef124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:52:56.378953 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:52:56.379361 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:52:55 up 39 min,  2 users,  load average: 8.23, 8.06, 5.23\n', 'num_instances': '5', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '5', 'num_proj_988d5ab3adc04c35abcbeada86625022': '1', 'io_workload': '3', 'num_proj_0501274670f84685b7449e324b329eb8': '1', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_7628b1959b0f48c8bc85aa076fa6ea71': '1', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '1', 'num_proj_c05f689c58a04254b3930f0cc279148c': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:52:56.392397 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Took 14.28 seconds to build instance.
Jun 26 02:52:56.474678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.485467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.514628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.725715 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:56.726170 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:56.726170 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:56.726261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:56.726384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Processing event network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:52:56.726548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:56.726708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:56.726852 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:56.726955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:56.727112 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] No waiting events found dispatching network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:56.727228 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-a57f9911-2003-486f-84ae-def8f45c4b09 req-ec5fd6ec-58b1-4575-94fe-0372c04e90b3 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received unexpected event network-vif-plugged-07d56f48-31a3-4499-9e44-ec684a89c432 for instance with vm_state building and task_state spawning.
Jun 26 02:52:56.727930 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:52:56.732294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:52:56.745294 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance spawned successfully.
Jun 26 02:52:56.745658 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:52:56.755857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:52:56.756076 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:52:56.843687 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:56.848019 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442376.8476715, a5d387b7-a9ad-4a06-8504-93a902496c23 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:56.848136 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] VM Resumed (Lifecycle Event)
Jun 26 02:52:56.873355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.876274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.879570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:56.893939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5432e407-2d61-48a0-b455-a614ea034c8b tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.782s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:56.909576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:57.253987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.254271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.254669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.254975 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.255327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.255687 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:57.260291 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:52:57.264640 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:57.351867 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:57.355070 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:57.770743 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Took 8.39 seconds to spawn the instance on the hypervisor.
Jun 26 02:52:57.772275 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:52:57.773165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.499s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:57.773165 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:57.773165 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 26 02:52:57.775436 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:57.858541 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:57.858787 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442377.8586125, 6a8fd917-0209-4446-b631-a83c282ef124 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:57.858917 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] VM Started (Lifecycle Event)
Jun 26 02:52:58.277507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] There are 0 instances to clean {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 26 02:52:58.277873 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:52:58.289647 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Took 14.51 seconds to build instance.
Jun 26 02:52:58.361455 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:58.363963 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442378.363705, 6a8fd917-0209-4446-b631-a83c282ef124 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:58.364102 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] VM Paused (Lifecycle Event)
Jun 26 02:52:58.642215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:52:58.791299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4cee63c1-ffd1-444d-a685-c87db9f6f078 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.021s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:58.799397 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:58.799907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:58.800153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:58.800336 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:58.800540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Processing event network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:52:58.800727 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:52:58.800854 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:52:58.801589 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:52:58.801818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:52:58.802159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:52:58.802685 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] No waiting events found dispatching network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:52:58.802685 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-123b821e-81b5-4f89-b785-21c662d42ec9 req-4c2b7b82-e9ab-4b3f-b146-602f7e7fc63b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received unexpected event network-vif-plugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 for instance with vm_state building and task_state spawning.
Jun 26 02:52:58.806505 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:52:58.809222 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Instance spawned successfully.
Jun 26 02:52:58.809769 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:52:58.867424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:58.873599 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442378.8730788, 6a8fd917-0209-4446-b631-a83c282ef124 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:58.873922 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] VM Resumed (Lifecycle Event)
Jun 26 02:52:59.278181 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.278451 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.278628 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.279038 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.280927 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.280927 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:52:59.280927 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.06 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:52:59.316760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.318904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.318904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.318904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.318904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.318904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:52:59.344085 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.345624 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:52:59.376578 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:59.382335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:52:59.823579 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Took 8.09 seconds to spawn the instance on the hypervisor.
Jun 26 02:52:59.823998 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:52:59.849277 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:52:59.885961 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:52:59.981434 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004797510000571492 future=<Future at 0x72e29c21b1d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:59.981603 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:52:59.983597 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Emitting event <LifecycleEvent: 1782442364.9807801, 1c9a1187-f037-466d-a024-edd1c1387e64 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:52:59.983597 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] VM Stopped (Lifecycle Event)
Jun 26 02:53:00.103837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:00.103976 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing instance network info cache due to event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:00.104129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] Acquiring lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:00.104253 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] Acquired lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:00.104412 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing network info cache for port 07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:00.335193 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Took 15.19 seconds to build instance.
Jun 26 02:53:00.485869 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 1c9a1187-f037-466d-a024-edd1c1387e64] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:00.606337 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:00.839178 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-13530cb5-bf8d-4a9c-be88-09dec2474f73 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.709s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:01.022589 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:01.167701 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updated VIF entry in instance network info cache for port 07d56f48-31a3-4499-9e44-ec684a89c432. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:53:01.168064 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating instance_info_cache with network_info: [{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:01.388094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-changed-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:01.388094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Refreshing instance network info cache due to event network-changed-7a1d3294-4501-4bcd-b52a-c3c45a8792a4. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:01.388094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] Acquiring lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:01.388094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] Acquired lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:01.388094 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Refreshing network info cache for port 7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:01.670218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-08a8663c-de3d-4d88-bd6e-101f6f3a1db0 req-3cbc0778-95ad-4f78-b133-94c50f099fa6 service nova] Releasing lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:01.811407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:01.899435 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:02.260718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:02.316768 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:02.552005 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updated VIF entry in instance network info cache for port 7a1d3294-4501-4bcd-b52a-c3c45a8792a4. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:53:02.552248 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updating instance_info_cache with network_info: [{"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:03.054200 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7d64b992-e891-474d-bf12-83989dfb370b req-2bab090f-0b4e-4b56-93e6-a6cee48f1f87 service nova] Releasing lock "refresh_cache-6a8fd917-0209-4446-b631-a83c282ef124" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:03.080782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:03.080782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:03.080782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:03.080782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:03.080782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:03.091341 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Terminating instance
Jun 26 02:53:03.514725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.594640 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:53:03.616083 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.619536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.644716 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.648166 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.655142 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.676422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.682394 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:03.780294 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:03.780563 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:03.780996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:03.780996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:03.780996 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] No waiting events found dispatching network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:03.781113 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d783020d-209c-4f2c-89d8-e05ae419fb0c req-13dbda19-2572-4c19-b214-65aaf9ee2d49 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:53:03.950792 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999464391999936 future=<Future at 0x72e29c339ca0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:03.951082 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999136952999834 future=<Future at 0x72e29c339ca0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:03.951278 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99893294399999 future=<Future at 0x72e29c339ca0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:03.952355 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Instance destroyed successfully.
Jun 26 02:53:03.953591 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lazy-loading 'resources' on Instance uuid 0ff63aa2-8b2d-42e2-b26a-1025252444a2 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:04.456740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1134210972',display_name='tempest-VolumesActionsTest-instance-1134210972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesactionstest-instance-1134210972',id=60,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:55Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7628b1959b0f48c8bc85aa076fa6ea71',ramdisk_id='',reservation_id='r-l5telklq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-217415062',owner_user_name='tempest-VolumesActionsTest-217415062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:52:56Z,user_data=None,user_id='977d9a5f3eb44dedb8603e2c29fd3290',uuid=0ff63aa2-8b2d-42e2-b26a-1025252444a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:53:04.457246 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converting VIF {"id": "3b8c868f-98d8-4470-9066-1b70011ee38d", "address": "fa:16:3e:63:3f:8f", "network": {"id": "1fb6bfdd-1270-46f9-b549-b971b1460051", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667056226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7628b1959b0f48c8bc85aa076fa6ea71", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c868f-98", "ovs_interfaceid": "3b8c868f-98d8-4470-9066-1b70011ee38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:04.457768 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:04.458303 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:53:04.459720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.459929 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b8c868f-98, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:04.460908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.463626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:04.463626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.463626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.463626 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a30fdd47-8643-4a0a-bc59-c49858d6ef77) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:04.463870 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.464968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:04.464968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:04.467560 np0000003683 nova-compute[98991]: INFO os_vif [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=3b8c868f-98d8-4470-9066-1b70011ee38d,network=Network(1fb6bfdd-1270-46f9-b549-b971b1460051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c868f-98')
Jun 26 02:53:04.467927 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Deleting instance files /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2_del
Jun 26 02:53:04.468701 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Deletion of /opt/stack/data/nova/instances/0ff63aa2-8b2d-42e2-b26a-1025252444a2_del complete
Jun 26 02:53:04.976887 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:53:04.977539 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:53:04.977745 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:53:04.977870 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:53:04.978186 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:05.066856 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:05.402167 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fdb7c19e-e228-4e39-b77d-36f568eb78ca req-ea6e9802-8aab-436a-a951-693b3f1255ec service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-deleted-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:05.403277 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-fdb7c19e-e228-4e39-b77d-36f568eb78ca req-ea6e9802-8aab-436a-a951-693b3f1255ec service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Neutron deleted interface 3b8c868f-98d8-4470-9066-1b70011ee38d; detaching it from the instance and deleting it from the info cache
Jun 26 02:53:05.404277 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fdb7c19e-e228-4e39-b77d-36f568eb78ca req-ea6e9802-8aab-436a-a951-693b3f1255ec service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Detach interface failed, port_id=3b8c868f-98d8-4470-9066-1b70011ee38d, reason: Instance 0ff63aa2-8b2d-42e2-b26a-1025252444a2 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:53:05.847636 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:53:05.847983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98991) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 26 02:53:05.849911 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:05.864612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:05.864824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] Acquiring lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:05.865000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:05.865154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:05.865304 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] No waiting events found dispatching network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:05.865439 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e0bcdd3-1cd8-4cc3-bd05-603f141a7c8c req-b9a49e9c-0461-4e0a-9748-3238e401b5b3 service nova] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Received event network-vif-unplugged-3b8c868f-98d8-4470-9066-1b70011ee38d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:53:06.330206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:06.350137 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:53:06.351921 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Took 1.37 seconds to deallocate network for instance.
Jun 26 02:53:06.861315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:06.861883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:07.173449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:07.173714 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:07.262408 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:07.676455 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:08.185260 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.324s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:08.233969 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Deleted allocations for instance 0ff63aa2-8b2d-42e2-b26a-1025252444a2
Jun 26 02:53:08.711420 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:09.244292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dea54cda-627e-4c67-b34d-76bad59c7c51 tempest-VolumesActionsTest-217415062 tempest-VolumesActionsTest-217415062-project-member] Lock "0ff63aa2-8b2d-42e2-b26a-1025252444a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:09.466265 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:11.682136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:11.682559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:12.183857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:53:12.265105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:12.857791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:12.858256 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:12.860789 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:53:12.860919 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Claim successful on node np0000003683
Jun 26 02:53:14.122979 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:14.123441 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:14.468424 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:14.625494 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:15.131449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:15.131880 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:53:15.637037 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:53:15.637551 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:53:15.640190 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:15.640190 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:15.703321 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:53:15.988205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:16.113621 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Successfully created port: 04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:53:16.137865 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:53:16.566617 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Successfully updated port: 04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:53:16.613942 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-changed-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:16.614034 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Refreshing instance network info cache due to event network-changed-04264872-f4d0-4f38-b065-dc80cec37147. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:16.614232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] Acquiring lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:16.614344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] Acquired lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:16.614495 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Refreshing network info cache for port 04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:16.641206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:53:17.068706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:17.116990 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:17.147409 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Booting with volume 11f3e00b-ca4b-4143-be48-fdc64beac752 at /dev/vda
Jun 26 02:53:17.192752 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:17.199706 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:53:17.207222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:17.232932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:17.267790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:17.293401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:17.293751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:17.306384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:17.307735 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef'] 
Jun 26 02:53:17.307936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:17.308084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:17.308360 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:17.308605 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Updating existing volume attachment record: e4b7154d-4d3f-48eb-b4af-32b2bafb99d5 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:17.387785 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:17.890687 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c2da9edb-ec0e-4352-83c7-6494da308bf9 req-46bb16f0-f640-40d4-a058-4d2c12288f0f service nova] Releasing lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:17.891419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:17.891656 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:53:18.451141 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:53:18.600902 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:18.726133 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Updating instance_info_cache with network_info: [{"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:18.950709 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004095179997420928 future=<Future at 0x72e29c339ca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:18.951923 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Emitting event <LifecycleEvent: 1782442383.950113, 0ff63aa2-8b2d-42e2-b26a-1025252444a2 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:18.952151 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:18.952339 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] VM Stopped (Lifecycle Event)
Jun 26 02:53:19.228070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-a439a1f0-321d-413e-9367-db7cb827d2e5" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:19.228313 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance network_info: |[{"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:53:19.416159 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:53:19.417375 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:53:19.417649 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Creating image(s)
Jun 26 02:53:19.417945 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:53:19.418125 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Ensure instance console log exists: /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:53:19.418389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:19.418600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:19.418717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:19.419143 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Start _get_guest_xml network_info=[{"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e4b7154d-4d3f-48eb-b4af-32b2bafb99d5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a439a1f0-321d-413e-9367-db7cb827d2e5', 'attached_at': '', 'detached_at': '', 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'serial': '11f3e00b-ca4b-4143-be48-fdc64beac752'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:53:19.423242 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:53:19.424332 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-388140529', uuid='a439a1f0-321d-413e-9367-db7cb827d2e5'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442399.4239855) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:53:19.425558 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:53:19.425909 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:53:19.426951 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:53:19.427134 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:53:19.428037 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:53:19.428291 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:53:19.428392 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:53:19.428489 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:53:19.428620 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:53:19.428696 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:53:19.428807 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:53:19.428948 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:53:19.429086 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:53:19.429244 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:53:19.429343 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:53:19.429449 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:53:19.439029 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:19.439348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:19.439467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:19.439791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:19.440004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:19.455176 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 0ff63aa2-8b2d-42e2-b26a-1025252444a2] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:19.455886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:19.456510 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:19.456656 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:19.457082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:19.457625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:19.457830 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:19.468965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:19.468965 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:19.469908 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:19.475809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:19.475809 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752] added
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:19.485419 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:19.485716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:19.485716 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:19.485839 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752] added
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:19.487809 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:19.488031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:19.488160 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:19.488321 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:20.486329 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:20.488732 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:20.501527 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:20.503630 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.514177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.520179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.529362 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.529362 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.529362 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:20.529600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.529600 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.529600 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:20.534874 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.534874 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.534874 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:20.535008 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.535008 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.535008 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:20.564980 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.50.100,3260]
Jun 26 02:53:20.564980 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:20.564980 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.581400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.589507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.40.100,3260]
Jun 26 02:53:20.589507 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:20.589507 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.595719 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.595719 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.595719 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.595719 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.595719 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:20.595964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.595964 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.595964 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.595964 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.595964 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:20.596315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:20.596467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:20.597261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('8', '-', '-', 0) found on session 152 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:20.597408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:20.605897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:20.618372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 152 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:20.618372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:20.624043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.624043 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.624043 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.624043 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.624043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:20.624310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.624310 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:20.624310 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.624310 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:20.624310 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:20.624429 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:20.624533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:20.625026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('9', '-', '-', 0) found on session 153 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:20.625135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:20.642023 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 153 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:20.642023 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:21.458550 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:53:22.270278 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:22.473528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000147eb071 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:22.473528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:22.474538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000147eb071', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000147eb071'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:22.474667 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000147eb071', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000147eb071'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:22.514297 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'a439a1f0-321d-413e-9367-db7cb827d2e5', 'attached_at': '', 'detached_at': '', 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'serial': '11f3e00b-ca4b-4143-be48-fdc64beac752'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:53:22.515089 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:53:22.515358 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:22.515579 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:22.533392 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:53:22.533752 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:53:22.533902 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:22.534014 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:22.534496 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x72e2a4184890>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'a439a1f0-321d-413e-9367-db7cb827d2e5', 'attached_at': '', 'detached_at': '', 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'serial': '11f3e00b-ca4b-4143-be48-fdc64beac752'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:53:22.534652 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:53:23.710402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:24.470584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:25.539620 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]:     <volume>11f3e00b-ca4b-4143-be48-fdc64beac752</volume>
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:53:26.495785 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:53:27.008869 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-388140529',display_name='tempest-TestVolumeBootPattern-server-388140529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-388140529',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-xssek1sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:53:17Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a439a1f0-321d-413e-9367-db7cb827d2e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:53:27.009327 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:27.009936 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:27.011295 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid a439a1f0-321d-413e-9367-db7cb827d2e5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:27.272730 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <uuid>a439a1f0-321d-413e-9367-db7cb827d2e5</uuid>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <name>instance-0000003f</name>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-388140529</nova:name>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:53:19</nova:creationTime>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <nova:port uuid="04264872-f4d0-4f38-b065-dc80cec37147">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="serial">a439a1f0-321d-413e-9367-db7cb827d2e5</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="uuid">a439a1f0-321d-413e-9367-db7cb827d2e5</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/disk.config"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <alias name="ua-11f3e00b-ca4b-4143-be48-fdc64beac752"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <serial>11f3e00b-ca4b-4143-be48-fdc64beac752</serial>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <encryption format="luks">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:         <secret type="passphrase" uuid="7eeb63d9-4b2d-4041-9beb-35a1f86735f2"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       </encryption>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1f:fc:66"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <target dev="tap04264872-f4"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/console.log" append="off"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:53:27.514254 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Preparing to wait for external event network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-388140529',display_name='tempest-TestVolumeBootPattern-server-388140529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-388140529',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-xssek1sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:53:17Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a439a1f0-321d-413e-9367-db7cb827d2e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:27.517922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:53:27.518925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.518925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b53579b8-bad1-5f66-892b-8ee2afb0d203', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:27.519364 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.519976 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:27.520751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.522655 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.522870 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04264872-f4, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:27.523197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04264872-f4, col_values=(('qos', UUID('3a3ea860-90a6-4f0e-88c4-8c02934e6bcd')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:27.523367 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04264872-f4, col_values=(('external_ids', {'iface-id': '04264872-f4d0-4f38-b065-dc80cec37147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:fc:66', 'vm-uuid': 'a439a1f0-321d-413e-9367-db7cb827d2e5'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:27.524090 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.526875 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:27.530992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:27.532039 np0000003683 nova-compute[98991]: INFO os_vif [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4')
Jun 26 02:53:28.917024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:28.917024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:28.917024 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Shelve offloading
Jun 26 02:53:29.047500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:29.047644 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:29.047791 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:1f:fc:66, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:29.048276 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Using config drive
Jun 26 02:53:29.554589 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:29.703307 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Creating config drive at /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/disk.config
Jun 26 02:53:29.707231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl2i0auco {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:29.781870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl2i0auco" returned: 0 in 0.074s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:29.950354 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:29.953906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:29.971632 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:29.976497 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:29.997792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.008003 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.098181 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:30.098744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:30.098943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:30.099057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:30.099191 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:30.099311 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-1d5c4618-113f-49af-8c1e-fd325ab3b258 req-be2cc63d-a2a9-4a2e-84d1-6d8fe5ef11a4 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received unexpected event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with vm_state active and task_state shelving.
Jun 26 02:53:30.224155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.259832 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.262016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.442285 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999471175000053 future=<Future at 0x72e29c314cb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:30.442855 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998893799999678 future=<Future at 0x72e29c314cb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:30.443220 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998623507000048 future=<Future at 0x72e29c314cb0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:30.445511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.450816 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance destroyed successfully.
Jun 26 02:53:30.452010 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'numa_topology' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:30.465095 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab6e03a3-9134-40d0-bf41-6010e12f505c req-09820a69-aae4-44ca-9875-8e1e734d788d service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:30.465095 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab6e03a3-9134-40d0-bf41-6010e12f505c req-09820a69-aae4-44ca-9875-8e1e734d788d service nova] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:30.465095 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab6e03a3-9134-40d0-bf41-6010e12f505c req-09820a69-aae4-44ca-9875-8e1e734d788d service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:30.465095 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab6e03a3-9134-40d0-bf41-6010e12f505c req-09820a69-aae4-44ca-9875-8e1e734d788d service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:30.465095 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab6e03a3-9134-40d0-bf41-6010e12f505c req-09820a69-aae4-44ca-9875-8e1e734d788d service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Processing event network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:53:30.593319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.601790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.603703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.634402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.640659 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:30.956361 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:30.963354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:30.963354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:30.963354 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:53:31.137399 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:31.137614 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:31.464590 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:31.642339 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:31.791163 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:31.914455 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:31.981640 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442411.9811878, a439a1f0-321d-413e-9367-db7cb827d2e5 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:31.982202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:53:31.982700 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] VM Started (Lifecycle Event)
Jun 26 02:53:31.984528 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:53:31.986941 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance spawned successfully.
Jun 26 02:53:31.987300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:53:32.154371 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:32.154894 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:32.155115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:32.155311 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:32.155464 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:32.155915 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ec06a281-69bb-4e5b-a628-d8a7ffe61f20 req-54b2d7f9-1d0e-469b-b831-df46b435088a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received unexpected event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with vm_state active and task_state shelving.
Jun 26 02:53:32.274573 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:32.417172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:32.417525 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:32.417850 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:32.485379 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:32.487542 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:53:32.493578 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.493699 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.493958 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.494139 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.494370 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.494580 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:53:32.523059 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:32.523569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:32.523808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:32.523927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:32.524044 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] No waiting events found dispatching network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:32.524206 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-dda1b0fc-3d03-44e4-be10-fec3c16bf3b6 req-03919133-71ec-4ffa-a9e8-7f138c2d2bda service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received unexpected event network-vif-plugged-04264872-f4d0-4f38-b065-dc80cec37147 for instance with vm_state building and task_state spawning.
Jun 26 02:53:32.524833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:32.647830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:32.862775 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance destroyed successfully.
Jun 26 02:53:32.863215 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'resources' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:32.992318 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:53:32.992783 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442412.9923937, a439a1f0-321d-413e-9367-db7cb827d2e5 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:32.992783 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] VM Paused (Lifecycle Event)
Jun 26 02:53:32.998813 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Took 13.58 seconds to spawn the instance on the hypervisor.
Jun 26 02:53:32.999047 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:33.365253 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Object Instance<2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294> lazy-loaded attributes: numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:53:33.366553 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm0ZDrs8Zw8sSSdJASOXnbEcwznd5W02ax34C1E1I0VPEpJSnoLmlusI+l+dRaSbzCrwpvGWwC+mjdRSAFE6gtTqBVwUXUofC5tSUpniGj3B/xEovZbiePKWMjCs9v55Q==',key_name='tempest-TestShelveInstance-113486237',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:52:50Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:53:33.366553 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:33.367042 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:33.367315 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:53:33.368569 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:33.368805 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b999a4-01, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:33.373670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:33.375000 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:33.375649 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:33.375833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd35656a-026b-4976-b49f-6cba0031fa90) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:33.376416 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:33.377044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:33.377638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:33.380392 np0000003683 nova-compute[98991]: INFO os_vif [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01')
Jun 26 02:53:33.382564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:53:33.382955 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:33.383233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:33.383877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:33.384360 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:53:33.384586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:33.413008 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:33.413310 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:33.413525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', '154')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:53:33.413525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '150')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:33.414553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '151')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:33.415252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c467b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:53:33.415511 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Removing multipathed devices sde, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:53:33.415750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flush multipath device 33000000053038c57 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:53:33.481333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:33.494895 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:33.497085 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442413.496812, a439a1f0-321d-413e-9367-db7cb827d2e5 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:33.497261 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] VM Resumed (Lifecycle Event)
Jun 26 02:53:33.510869 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Took 20.82 seconds to build instance.
Jun 26 02:53:33.529771 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:33.576377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:53:33.576530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:53:33.577358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:53:33.589223 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:53:33.589400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:53:33.600806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.632739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260]
Jun 26 02:53:33.632739 np0000003683 nova-compute[98991]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:33.632739 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.647643 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.660097 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.695509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260]
Jun 26 02:53:33.695509 np0000003683 nova-compute[98991]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:33.695509 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.710643 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:33.710939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:33.711096 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== disconnect_volume: return (328ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:33.711288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:53:33.711550 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deleting instance files /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294_del
Jun 26 02:53:33.713835 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deletion of /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294_del complete
Jun 26 02:53:33.723338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:33.723540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:33.724171 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Attaching volume 17ff810d-0fd4-4404-895f-f8e3d3cdca9d to /dev/vdb
Jun 26 02:53:33.769894 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:33.782496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:33.807612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:33.852472 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:33.853403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:33.862985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:33.864340 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe1f:fc66', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:53:33.864489 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:33.864626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:33.864839 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:33.865067 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating existing volume attachment record: e204f32a-7ce2-4642-90cc-fcc71f089b63 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:34.000086 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:34.004648 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:53:34.012571 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f5849421-8712-4e06-9734-12ef94927ee3 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.330s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:34.217456 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-changed-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:34.218366 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing instance network info cache due to event network-changed-b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:34.218686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:34.219161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:34.219379 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing network info cache for port b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:34.417527 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:34.417824 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:34.417972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:34.418352 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:34.418610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:34.430384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:34.431411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:34.432035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:34.432271 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:34.432879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:34.433267 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:34.443058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:34.443058 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:34.446563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:34.446563 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d] added
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:34.457116 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:34.457312 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:34.457429 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:34.457601 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d] added
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:34.462165 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:34.462410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:34.462731 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:34.462921 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:34.721711 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:34.727403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:34.727698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:34.808629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:34.808893 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:34.809072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:34.809257 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:34.809373 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:34.811758 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Terminating instance
Jun 26 02:53:35.008232 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:35.121510 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updated VIF entry in instance network info cache for port b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:53:35.121795 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": null, "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb7b999a4-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:35.232240 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:35.314898 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:53:35.342262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.344550 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.362852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.370611 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.394758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.400210 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.425755 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Deleted allocations for instance 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294
Jun 26 02:53:35.458126 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:35.463279 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:35.471136 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:35.477742 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.483882 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.491827 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.499944 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:35.499944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:35.500677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:35.500677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:35.500677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] No waiting events found dispatching network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:35.500677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-407de5d5-a8b1-4ffc-941d-47a4fed15fd8 req-52d1ffde-230d-46e8-b298-8de1e7a76b52 service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.501885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:35.507661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.507661 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.507661 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.507661 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:35.507947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.507947 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.507947 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.507947 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:35.549781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.50.100,3260]
Jun 26 02:53:35.549781 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:35.549781 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.552009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.40.100,3260]
Jun 26 02:53:35.552009 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:35.552009 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.564836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.569198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.578748 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.578962 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:35.579374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:35.579563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:35.580589 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] HCTL ('10', '-', '-', 0) found on session 156 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:35.580745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.586171 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:35.586382 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:35.586807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:35.587118 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:35.587770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] HCTL ('7', '-', '-', 0) found on session 155 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:35.587897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:35.598363 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching for a device in session 156 and hctl ['10', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:35.598592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:35.607997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching for a device in session 155 and hctl ['7', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:35.609168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:35.614986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.623726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d30d5210-86b1-4058-b926-c8a8254ff89a req-9fb63152-21de-4385-8156-05290bc4e074 service nova] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:35.624206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:35.646456 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999636804000147 future=<Future at 0x72e27c4e5190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:35.652532 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Instance destroyed successfully.
Jun 26 02:53:35.653791 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid a439a1f0-321d-413e-9367-db7cb827d2e5 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:35.931877 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:35.932078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:35.978067 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Refreshing inventories for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 26 02:53:36.015986 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Updating ProviderTree inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 26 02:53:36.016449 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:53:36.072503 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Refreshing aggregate associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, aggregates: None {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 26 02:53:36.123946 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Refreshing trait associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_RISCV64,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_LAN9118 {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 26 02:53:36.157798 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-388140529',display_name='tempest-TestVolumeBootPattern-server-388140529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-388140529',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:53:33Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-xssek1sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:53:33Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a439a1f0-321d-413e-9367-db7cb827d2e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:53:36.159349 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "04264872-f4d0-4f38-b065-dc80cec37147", "address": "fa:16:3e:1f:fc:66", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04264872-f4", "ovs_interfaceid": "04264872-f4d0-4f38-b065-dc80cec37147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:36.159986 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:36.160239 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:53:36.161755 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.161996 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04264872-f4, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:36.162894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.163570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:36.164130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.164885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.165045 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a3ea860-90a6-4f0e-88c4-8c02934e6bcd) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:36.165592 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.165958 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:36.166365 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:36.168232 np0000003683 nova-compute[98991]: INFO os_vif [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:fc:66,bridge_name='br-int',has_traffic_filtering=True,id=04264872-f4d0-4f38-b065-dc80cec37147,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04264872-f4')
Jun 26 02:53:36.171137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:53:36.171415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:36.171547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:36.237994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:36.387230 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:36.387654 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:36.432493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:53:36.890742 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:37.246720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:37.276370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:37.319071 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:37.319304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:37.319637 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attaching volume e468ef0f-cf10-4197-995e-7e9e013410e9 to /dev/vdb
Jun 26 02:53:37.358378 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:37.369496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:37.390931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:37.406998 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.474s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:37.426974 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:37.427279 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:37.436313 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:37.436646 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:37.448232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:37.449516 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] 
Jun 26 02:53:37.449516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:37.449516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:37.449757 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:37.449916 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating existing volume attachment record: 1937ecef-27de-4b8f-9620-a7d5d3e12ecf {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:37.453512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found WWN 33000000076d8c7da for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:37.453985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:37.454138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000076d8c7da', 'path': '/dev/dm-1', 'multipath_id': '33000000076d8c7da'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:37.454274 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000076d8c7da', 'path': '/dev/dm-1', 'multipath_id': '33000000076d8c7da'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:37.455443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.284s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:37.455923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11f3e00b-ca4b-4143-be48-fdc64beac752', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:53:37.456117 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:53:37.458818 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:37.483555 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash)
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:37.483992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '156')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:53:37.484279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '153')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:37.484971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752', '152')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:37.486638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c2e0b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:53:37.486829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdd, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:53:37.487089 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000147eb071 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:53:37.526952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:37.555204 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:37.555263 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] Acquiring lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:37.555502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:37.555586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:37.555703 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] No waiting events found dispatching network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:53:37.555823 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7c939271-c06f-440e-952a-3a6b8d7a9e44 req-625f265e-2e57-45bc-9a46-f42bd4ed044c service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-unplugged-04264872-f4d0-4f38-b065-dc80cec37147 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:53:37.580301 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:37.630979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:53:37.631179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:53:37.632139 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:53:37.643383 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:53:37.643617 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:53:37.654844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.680649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.40.100,3260]
Jun 26 02:53:37.680649 np0000003683 nova-compute[98991]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:37.680649 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.695385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.708268 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.743864 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.50.100,3260]
Jun 26 02:53:37.743864 np0000003683 nova-compute[98991]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:37.743864 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.761567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:37.762630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:37.762760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (1591ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:37.762875 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:53:37.763152 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Deleting instance files /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5_del
Jun 26 02:53:37.763597 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Deletion of /opt/stack/data/nova/instances/a439a1f0-321d-413e-9367-db7cb827d2e5_del complete
Jun 26 02:53:37.915082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-055780db-bbb4-468a-b722-9e79235e0caa tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.999s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:37.916341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.669s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:37.916998 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Unshelving
Jun 26 02:53:37.933451 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:37.961859 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Attempting to attach volume 17ff810d-0fd4-4404-895f-f8e3d3cdca9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:   <alias name="ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d"/>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:   <serial>17ff810d-0fd4-4404-895f-f8e3d3cdca9d</serial>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:37.963532 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:53:38.010342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:38.010671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:38.010840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:38.011651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:38.011846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:38.023410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:38.024331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:38.024833 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:38.025197 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:38.025897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:38.026228 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:38.036642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:38.036642 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:38.043172 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:38.043172 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9] added
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:38.049215 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:38.049431 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:38.049509 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:38.049674 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9] added
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:38.055860 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:38.056042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:38.056331 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:38.056489 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:38.271168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Took 2.96 seconds to destroy the instance on the hypervisor.
Jun 26 02:53:38.272882 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:53:38.273363 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:53:38.273514 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:53:38.273769 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:38.331728 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:38.436686 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Ignoring supplied device name: /dev/vdb
Jun 26 02:53:38.627629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12a3c994-07f4-44d3-be6f-0c9702655919 req-6ddabb79-58a9-4cfc-93d0-462da7f9756e service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Received event network-vif-deleted-04264872-f4d0-4f38-b065-dc80cec37147 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:38.627780 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-12a3c994-07f4-44d3-be6f-0c9702655919 req-6ddabb79-58a9-4cfc-93d0-462da7f9756e service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Neutron deleted interface 04264872-f4d0-4f38-b065-dc80cec37147; detaching it from the instance and deleting it from the info cache
Jun 26 02:53:38.630143 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12a3c994-07f4-44d3-be6f-0c9702655919 req-6ddabb79-58a9-4cfc-93d0-462da7f9756e service nova] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Detach interface failed, port_id=04264872-f4d0-4f38-b065-dc80cec37147, reason: Instance a439a1f0-321d-413e-9367-db7cb827d2e5 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:53:38.925244 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Booting with volume f12a25be-e0f3-4e2b-b8f2-4744459a3903 at /dev/vda
Jun 26 02:53:38.939490 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:38.961418 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:38.970901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:38.986621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:39.036191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:39.036506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:39.045623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:39.046809 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] 
Jun 26 02:53:39.047025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:39.047142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:39.047427 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:39.047678 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating existing volume attachment record: 59dcc072-348b-47cd-93b8-7f1ac3c735dc {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:39.051159 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:39.056981 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:39.064367 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:39.071224 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.072960 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:39.078699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.087347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.095774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.104025 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:39.145077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.40.100,3260]
Jun 26 02:53:39.145077 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:39.145077 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.159949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.175134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.50.100,3260]
Jun 26 02:53:39.175134 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:39.175134 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.180931 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.181299 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:39.181459 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:39.181648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:39.182412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('8', '-', '-', 0) found on session 157 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:39.182539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:39.188424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:39.198185 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 157 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:39.198386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.202327 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:39.202551 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:39.202786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:39.202891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:39.203525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('9', '-', '-', 0) found on session 158 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:39.203628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:39.215235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 158 and hctl ['9', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:39.574946 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Took 1.30 seconds to deallocate network for instance.
Jun 26 02:53:39.627863 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:39.628004 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:39.628165 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:39.628303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No VIF found with MAC fa:16:3e:1b:47:8e, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:40.024670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:40.025010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:40.025293 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Attaching volume 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae to /dev/vdb
Jun 26 02:53:40.063876 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:40.075744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:40.096502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:40.124529 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:53:40.138451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:40.138853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:40.150278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:40.151442 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] 
Jun 26 02:53:40.151630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:40.151752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:40.152014 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:40.152254 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updating existing volume attachment record: 7f5845ab-c0fb-44a9-9c78-e1ef6f03a5cf {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:40.216137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 158 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:40.216387 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:40.633709 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:40.634239 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:40.715474 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:40.721825 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:40.723251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:40.723935 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:40.891573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:40.891817 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:41.042688 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found WWN 330000000b0c2227f for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:41.043035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:41.043227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000b0c2227f', 'path': '/dev/dm-0', 'multipath_id': '330000000b0c2227f'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:41.043402 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b0c2227f', 'path': '/dev/dm-0', 'multipath_id': '330000000b0c2227f'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:41.043816 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.320s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:41.045644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:41.045966 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:41.056438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:41.057192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:41.057790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:41.057996 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:41.058643 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:41.058864 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:41.068926 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:41.068926 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:41.073547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:41.073547 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae] added
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:41.080170 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:41.080440 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:41.080515 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:41.080733 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae] added
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:41.083717 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:41.084041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:41.084129 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:41.084244 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:41.166681 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:41.175446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-14d58750-a8f9-406b-9768-d7ea6c778b63 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.452s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:41.394794 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:41.551309 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to attach volume e468ef0f-cf10-4197-995e-7e9e013410e9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:   <alias name="ua-e468ef0f-cf10-4197-995e-7e9e013410e9"/>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:   <serial>e468ef0f-cf10-4197-995e-7e9e013410e9</serial>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:41.552662 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:53:41.903288 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.269s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:41.904722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.188s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:41.906614 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'pci_requests' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:41.971465 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance a439a1f0-321d-413e-9367-db7cb827d2e5
Jun 26 02:53:42.082001 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:42.084683 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:42.096367 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:42.101122 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.107232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.112711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.124058 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.124309 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.125708 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.125965 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:42.157717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.40.100,3260]
Jun 26 02:53:42.157717 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:42.157717 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.166780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.50.100,3260]
Jun 26 02:53:42.166780 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:42.166780 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.171317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.178495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.189237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.189424 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:42.189626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:42.189728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:42.190625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] HCTL ('12', '-', '-', 0) found on session 159 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:42.190683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.195287 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:42.195640 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:42.195862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:42.195862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:42.196720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] HCTL ('13', '-', '-', 0) found on session 160 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:42.196828 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:42.205525 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching for a device in session 159 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:42.205612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:42.215209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Searching for a device in session 160 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:42.215209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:42.277722 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:42.413947 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'numa_topology' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:42.916417 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:53:42.916939 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Claim successful on node np0000003683
Jun 26 02:53:42.980835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-37eaebfc-632a-46d3-9b91-885a13ee7304 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a439a1f0-321d-413e-9367-db7cb827d2e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.172s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:43.058676 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:53:43.205086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:43.205086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:43.205086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:43.205086 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:2e:ea:a9, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:44.081299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found WWN 330000000ea19899d for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:44.082612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:44.082612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== connect_volume: return (3358ms) {'type': 'block', 'scsi_wwn': '330000000ea19899d', 'path': '/dev/dm-2', 'multipath_id': '330000000ea19899d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:44.082612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea19899d', 'path': '/dev/dm-2', 'multipath_id': '330000000ea19899d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:44.085686 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:44.152035 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:44.152310 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:44.575860 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:44.589723 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Attempting to attach volume 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:   <alias name="ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae"/>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:   <serial>9d49b35d-ed83-4b48-8eaa-e04ae16c4aae</serial>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:44.591505 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:53:44.655013 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:44.758121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b3a6d80-db0e-4438-9ce8-7de523ea690e tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.439s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:44.758838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.183s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:45.088603 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:45.089105 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:45.161197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.258s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:45.161929 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:45.229813 np0000003683 nova-compute[98991]: INFO nova.network.neutron [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating port b7b999a4-0155-4154-9107-2c63992903ec with attributes {'binding:host_id': 'np0000003683', 'device_owner': 'compute:nova'}
Jun 26 02:53:45.261864 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:45.442196 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004527000000962289 future=<Future at 0x72e29c314cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:45.442799 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Emitting event <LifecycleEvent: 1782442410.4415882, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:45.442959 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:45.443225 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Stopped (Lifecycle Event)
Jun 26 02:53:45.444182 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.201821507000204 future=<Future at 0x72e27c4e5190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:45.444342 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.201669944000059 future=<Future at 0x72e27c4e5190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:45.591033 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Detaching volume 17ff810d-0fd4-4404-895f-f8e3d3cdca9d
Jun 26 02:53:45.642700 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Attempting to driver detach volume 17ff810d-0fd4-4404-895f-f8e3d3cdca9d from mountpoint /dev/vdb
Jun 26 02:53:45.650460 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found disk vdb by alias ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:53:45.652258 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found disk vdb by alias ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:53:45.652419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Attempting to detach device vdb from instance fbed1f7d-1080-4781-aaca-03b672cb4168 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <alias name="ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d"/>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <serial>17ff810d-0fd4-4404-895f-f8e3d3cdca9d</serial>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:45.652976 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:53:45.664509 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully detached device vdb from instance fbed1f7d-1080-4781-aaca-03b672cb4168 from the persistent domain config.
Jun 26 02:53:45.664806 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] (1/8): Attempting to detach device vdb with device alias ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d from instance fbed1f7d-1080-4781-aaca-03b672cb4168 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <alias name="ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d"/>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-1"/>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <serial>17ff810d-0fd4-4404-895f-f8e3d3cdca9d</serial>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:45.665153 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:53:45.945449 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:46.126083 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442426.1249933, fbed1f7d-1080-4781-aaca-03b672cb4168 => ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:53:46.126742 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-17ff810d-0fd4-4404-895f-f8e3d3cdca9d for instance fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:53:46.128789 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully detached device vdb from instance fbed1f7d-1080-4781-aaca-03b672cb4168 from the live domain config.
Jun 26 02:53:46.130144 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:53:46.130144 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:46.130144 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:46.131020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:46.131020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:53:46.131020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:46.157231 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:46.157560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:53:46.157876 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '155')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:46.158579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '156')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:53:46.159277 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4bed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:53:46.159465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Removing multipathed devices sde, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:53:46.159715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flush multipath device 33000000076d8c7da {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:53:46.167925 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:46.173497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:46.173644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:46.173779 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:53:46.201021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:46.223176 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-changed-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:46.223362 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing instance network info cache due to event network-changed-b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:46.223530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:46.238841 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:46.239281 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:46.239424 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:46.239594 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] No VIF found with MAC fa:16:3e:de:7f:47, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:46.243370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:53:46.269581 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:46.293462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:46.293652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:46.298256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:53:46.298438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:53:46.299434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:53:46.311272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:53:46.311492 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:53:46.323119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.353466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.40.100,3260]
Jun 26 02:53:46.353466 np0000003683 nova-compute[98991]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:46.353466 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.369940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.381607 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.409428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.50.100,3260]
Jun 26 02:53:46.409428 np0000003683 nova-compute[98991]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:46.409428 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.423135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:46.423372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:46.423500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== disconnect_volume: return (293ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:46.423625 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:53:46.675537 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:46.795717 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:53:46.973227 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:46.989047 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:47.113935 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:47.151714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:47.152189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:47.152189 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attaching volume fb02ec99-ccf7-431e-8e6d-ce6b5593f717 to /dev/vdc
Jun 26 02:53:47.192061 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:47.202835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:47.223429 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:47.266990 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:47.267278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:47.277363 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:47.279262 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] 
Jun 26 02:53:47.279262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:47.279466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:47.279741 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:47.280075 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating existing volume attachment record: c088bc2f-c334-4b56-9022-c705a6aabf78 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:47.282044 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:47.351487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:47.351752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:47.356701 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:53:47.356838 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Claim successful on node np0000003683
Jun 26 02:53:47.616159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:47.617275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:53:47.617659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:47.617659 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing network info cache for port b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:47.618409 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating image(s)
Jun 26 02:53:47.618860 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:53:47.619017 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Ensure instance console log exists: /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:53:47.619403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:47.619594 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:47.619739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:47.620269 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start _get_guest_xml network_info=[{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '59dcc072-348b-47cd-93b8-7f1ac3c735dc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294', 'attached_at': '', 'detached_at': '', 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'serial': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:53:47.622876 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:53:47.623863 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1995686116', uuid='2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294'), owner=OwnerMeta(userid='5e067d2b47da4bb1a1457fa0ad72628f', username='tempest-TestShelveInstance-816092709-project-member', projectid='988d5ab3adc04c35abcbeada86625022', projectname='tempest-TestShelveInstance-816092709'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442427.623576) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:53:47.625202 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:53:47.625988 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:53:47.626970 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:53:47.627162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:53:47.628178 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:53:47.628445 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:53:47.628623 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:53:47.628752 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:53:47.628906 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:53:47.629028 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:53:47.629166 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:53:47.629531 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:53:47.629656 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:53:47.629791 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:53:47.629917 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:53:47.630059 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:53:47.630229 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:47.796664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-021cff8f-6a60-4d94-8f6e-bb5a11ed6740 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.772s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:47.862425 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a5d387b7-a9ad-4a06-8504-93a902496c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'serial': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:53:47.864180 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:47.864298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:47.864536 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:47.864868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:47.865156 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:47.879641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:47.880978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:47.881612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:47.881874 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:47.882288 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:47.882511 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:47.893214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:47.893214 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:47.898335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:47.898335 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717] added
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:47.905215 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:47.905541 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:47.905793 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:47.906397 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717] added
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:47.909007 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:47.909192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:47.909336 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:47.909570 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:47.979122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-277ddf97-fe14-4c83-9cd5-0eb1e5e64677 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.890s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:48.121497 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:48.132016 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Object Instance<2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:53:48.143167 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:48.143433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:48.143584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:48.414363 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:48.571155 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updated VIF entry in instance network info cache for port b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:53:48.571384 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:48.668857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:48.669087 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:48.906522 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:48.910019 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:48.918317 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:48.924001 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.930026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.936507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.944085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.944085 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.944085 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.944085 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.944085 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:48.944258 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.944258 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.944258 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.944258 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.944258 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:48.949927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.949927 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.949927 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.949927 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.949927 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:48.950073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.950073 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:48.950073 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.950073 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:48.950073 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:48.983068 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.40.100,3260]
Jun 26 02:53:48.983068 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:48.983068 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.983810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.50.100,3260]
Jun 26 02:53:48.983810 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:48.983810 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:48.995713 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:49.000675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.010549 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.010836 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:49.011177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:49.011371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:49.012466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('7', '-', '-', 0) found on session 161 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:49.012619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.017147 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:49.017403 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:49.017620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:49.017746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:49.018495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('10', '-', '-', 0) found on session 162 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:49.018617 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:49.025921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 161 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:49.031723 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 162 and hctl ['10', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:49.073221 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff60ceb3-9f48-4ec4-ae14-b3a83e86e126 req-3926ae4f-361b-4d78-be4d-0f5f98a3929a service nova] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:49.171606 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:49.677809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.326s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:49.678346 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:53:50.026651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 161 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:50.026856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:50.032374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 162 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:50.032606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:50.183499 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:53:50.183594 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:53:50.183831 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:50.184035 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:50.249293 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:53:50.447429 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:50.638532 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Successfully created port: 19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:53:50.646570 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003792569996221573 future=<Future at 0x72e27c4e5190 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:50.646570 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:53:50.647141 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] Emitting event <LifecycleEvent: 1782442415.6459079, a439a1f0-321d-413e-9367-db7cb827d2e5 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:53:50.647273 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] VM Stopped (Lifecycle Event)
Jun 26 02:53:50.686248 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:53:50.882456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:53:50.952999 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] instance snapshotting
Jun 26 02:53:51.060044 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Beginning live snapshot process
Jun 26 02:53:51.107585 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Successfully updated port: 19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:53:51.149730 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-48dbe5b7-6e05-4b4b-97d5-2365ded33f67 tempest-AttachVolumeNegativeTest-918921231 tempest-AttachVolumeNegativeTest-918921231-project-member] [instance: a439a1f0-321d-413e-9367-db7cb827d2e5] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:53:51.152068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-changed-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:51.152068 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Refreshing instance network info cache due to event network-changed-19428767-2826-454e-b432-e140cae158f7. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:53:51.152201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] Acquiring lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:51.152318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] Acquired lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:51.152429 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Refreshing network info cache for port 19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:53:51.169251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:51.188998 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:53:51.609492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:53:51.654517 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:51.692863 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Booting with volume d0b9cf06-70bc-407d-a438-a14a397c553d at /dev/vda
Jun 26 02:53:51.716900 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:53:51.729441 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:51.740532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:53:51.761314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:51.805192 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:53:51.805582 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:53:51.814251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:53:51.815366 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] 
Jun 26 02:53:51.815531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:53:51.815644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:53:51.815928 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:51.816156 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Updating existing volume attachment record: 77ba0172-a387-4262-b4ee-2639e84c8dbb {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:53:51.854113 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:51.897597 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found WWN 330000000fc653794 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:51.898248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:51.898891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.755s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:51.898891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:51.899564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '330000000fc653794', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fc653794'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:51.899723 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fc653794', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fc653794'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:51.903335 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:53:51.903599 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:51.903740 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:51.911269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:51.911905 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:51.912441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:51.912708 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:51.913046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:51.913289 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:51.924653 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:53:51.925076 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:53:51.925561 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:51.925561 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:51.925847 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:51.926012 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:51.926735 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x72e27c573aa0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'a5d387b7-a9ad-4a06-8504-93a902496c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'serial': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:53:51.926888 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:53:51.931028 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:51.931028 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903] added
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:51.939745 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:51.940007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:51.940182 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:51.940367 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903] added
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:51.945015 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:51.945336 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:51.945392 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:51.945564 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:52.357125 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a59466e6-ea6f-427b-8adc-9f5cabcdb60d req-3b0a9050-5170-482a-9d0e-cce0523df516 service nova] Releasing lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:52.359122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:53:52.359402 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:53:52.573355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:52.660800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json -f qcow2" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:52.661317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json -f qcow2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:52.754002 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:52.755002 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:53:52.757671 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:53:52.758024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:52.844406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:52.844879 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b.delta 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:52.909708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b.delta 1073741824" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:52.910418 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 26 02:53:52.940955 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:52.946242 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:52.949685 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:52.958507 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:52.965856 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:52.976158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:52.983715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:52.993205 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:52.993555 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.002310 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:53.036395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260]
Jun 26 02:53:53.036395 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:53.036395 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:53.047416 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:53.052435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260]
Jun 26 02:53:53.052435 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:53.052435 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.066032 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.066422 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:53.066647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:53.066647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:53.067291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:53.068145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] HCTL ('11', '-', '-', 0) found on session 163 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:53.068255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:53.085804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching for a device in session 163 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:53.085956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] HCTL ('14', '-', '-', 0) found on session 164 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:53.092328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:53.107807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Searching for a device in session 164 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:53.107807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:53.157362 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:53.213965 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] COPY block job progress, current cursor: 65536 final cursor: 76742656 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:53:53.338560 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Updating instance_info_cache with network_info: [{"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:53:53.716842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98991) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 26 02:53:53.718931 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 26 02:53:53.758824 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:53:53.759262 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b.delta /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:53.841276 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-9804bb3e-2bed-43e8-93b5-62af4824a081" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:53:53.841865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance network_info: |[{"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:53:53.846397 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:53:53.846856 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:53:53.846998 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:53:53.847311 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:53:53.914190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:53:53.938702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:53:53.940511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:53:53.940883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b.delta /opt/stack/data/nova/instances/snapshots/tmpw1hxck_k/ba34f72cec874176af3f701825570a9b" returned: 0 in 0.182s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:53.941078 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Creating image(s)
Jun 26 02:53:53.941433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:53:53.941583 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Ensure instance console log exists: /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:53:53.941873 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:53.942053 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:53.942197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:53.942819 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Start _get_guest_xml network_info=[{"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77ba0172-a387-4262-b4ee-2639e84c8dbb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9804bb3e-2bed-43e8-93b5-62af4824a081', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'serial': 'd0b9cf06-70bc-407d-a438-a14a397c553d'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:53:53.945243 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:53:53.946292 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1521149999', uuid='9804bb3e-2bed-43e8-93b5-62af4824a081'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442433.9459434) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:53:53.946688 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Snapshot extracted, beginning image upload
Jun 26 02:53:53.949377 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:53:53.949744 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:53:53.953498 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:53:53.964956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:53:53.965291 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:53:53.965522 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:54.354436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:54.354707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:54.354883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:54.355075 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:53:54.932650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Found WWN 33000000053038c57 for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:54.933046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:54.933194 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== connect_volume: return (6789ms) {'type': 'block', 'scsi_wwn': '33000000053038c57', 'path': '/dev/dm-3', 'multipath_id': '33000000053038c57'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:54.933338 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053038c57', 'path': '/dev/dm-3', 'multipath_id': '33000000053038c57'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:54.933970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.968s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:54.934199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:53:54.948193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:54.949005 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:53:54.949625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:54.950257 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:54.951533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:53:54.951735 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:54.964687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:54.964687 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:54.969994 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:53:54.969994 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d] added
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:54.979328 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:54.979557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:54.979757 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:54.980050 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d] added
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:53:54.982145 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:54.982371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:53:54.982488 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:53:54.982647 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:53:55.379641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.440166 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-113486237',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:53:38Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:53:55.440549 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:55.441394 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:55.442714 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:55.478106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.478642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.567645 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.572692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.664557 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.665028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.763575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.763987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:53:55.768286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.857238 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.857899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]:     <volume>fb02ec99-ccf7-431e-8e6d-ce6b5593f717</volume>
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:53:55.885361 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:53:55.902648 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:55.945685 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Object Instance<2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <uuid>2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</uuid>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <name>instance-0000003a</name>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestShelveInstance-server-1995686116</nova:name>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:53:47</nova:creationTime>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:user uuid="5e067d2b47da4bb1a1457fa0ad72628f">tempest-TestShelveInstance-816092709-project-member</nova:user>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:project uuid="988d5ab3adc04c35abcbeada86625022">tempest-TestShelveInstance-816092709</nova:project>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         <nova:port uuid="b7b999a4-0155-4154-9107-2c63992903ec">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="serial">2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="uuid">2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <alias name="ua-f12a25be-e0f3-4e2b-b8f2-4744459a3903"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-3"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <serial>f12a25be-e0f3-4e2b-b8f2-4744459a3903</serial>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b6:73:a3"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <target dev="tapb7b999a4-01"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/console.log" append="off"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:53:55.949974 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:53:55.952414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Preparing to wait for external event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:53:55.952576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:55.952765 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:55.952902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:55.953721 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-113486237',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:49Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:53:38Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:53:55.953924 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:53:55.955868 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:53:55.957018 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:53:55.957779 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:55.958235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:55.958622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:53:55.960256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:55.960511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0b66546-8774-53c3-9c47-0839f8e0d9d2', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:55.962982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:55.966538 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:55.966838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:53:55.967653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:55.967883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b999a4-01, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:55.968605 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7b999a4-01, col_values=(('qos', UUID('231b8dde-465a-46d5-bc68-b42c3d093a0d')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:55.968605 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7b999a4-01, col_values=(('external_ids', {'iface-id': 'b7b999a4-0155-4154-9107-2c63992903ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:73:a3', 'vm-uuid': '2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:53:55.970926 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:55.972411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:53:55.973027 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:53:55.974070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:55.987370 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:53:55.990227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:56.002938 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:53:56.003800 np0000003683 nova-compute[98991]: INFO os_vif [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01')
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:56.017539 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:53:56.024649 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.030985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:56.031589 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50672MB free_disk=71.92369079589844GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:53:56.031745 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:56.031958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:56.039532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.047659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.059512 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.066792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.067125 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:56.113195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.50.100,3260]
Jun 26 02:53:56.113195 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.50.100,3260] successful.
Jun 26 02:53:56.113195 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.121145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.40.100,3260]
Jun 26 02:53:56.121145 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.40.100,3260] successful.
Jun 26 02:53:56.121145 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.127883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.135242 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.145103 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.145423 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:56.145626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:56.145692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:56.147145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('15', '-', '-', 0) found on session 165 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:56.147145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.153700 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:53:56.154043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:53:56.154338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:56.154338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:53:56.155446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('16', '-', '-', 0) found on session 166 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:53:56.155596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:53:56.161188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 165 and hctl ['15', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:56.169368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 166 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:56.169368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:56.377847 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Snapshot image upload complete
Jun 26 02:53:56.378427 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b19cb9f8-5e67-4cd4-be83-6cb7adcf7b02 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Took 5.42 seconds to snapshot the instance on the hypervisor.
Jun 26 02:53:56.410050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to attach volume fb02ec99-ccf7-431e-8e6d-ce6b5593f717 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <alias name="ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717"/>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <serial>fb02ec99-ccf7-431e-8e6d-ce6b5593f717</serial>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="874d3b0e-34ab-4cd4-bd9c-bd6d2ed70eaf"/>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:53:56.411724 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:53:57.084994 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbed1f7d-1080-4781-aaca-03b672cb4168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:53:57.085418 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a5d387b7-a9ad-4a06-8504-93a902496c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:53:57.085418 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 6a8fd917-0209-4446-b631-a83c282ef124 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:53:57.085418 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:53:57.085418 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 9804bb3e-2bed-43e8-93b5-62af4824a081 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:53:57.085570 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:53:57.085649 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:53:56 up 40 min,  2 users,  load average: 5.39, 7.37, 5.17\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_image_uploading': '1', 'num_os_type_None': '5', 'num_proj_0501274670f84685b7449e324b329eb8': '1', 'io_workload': '1', 'num_task_None': '2', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '1', 'num_proj_c05f689c58a04254b3930f0cc279148c': '1', 'num_vm_building': '1', 'num_task_spawning': '2', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'num_vm_shelved_offloaded': '1', 'num_proj_988d5ab3adc04c35abcbeada86625022': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:53:57.161269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 165 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:53:57.161431 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:53:57.354891 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:53:57.355150 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:53:57.536755 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:57.536916 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:57.536990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] No VIF found with MAC fa:16:3e:b6:73:a3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:57.538082 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Using config drive
Jun 26 02:53:57.858338 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:53:57.972867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 33000000066e4f076 for multipath device dm-6 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:53:57.973285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:53:57.975661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (4009ms) {'type': 'block', 'scsi_wwn': '33000000066e4f076', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000066e4f076'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:53:57.975958 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066e4f076', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000066e4f076'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:53:58.005682 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '9804bb3e-2bed-43e8-93b5-62af4824a081', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'serial': 'd0b9cf06-70bc-407d-a438-a14a397c553d'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:53:58.006240 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:53:58.006454 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:58.006619 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:53:58.007139 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x72e27c446600>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '9804bb3e-2bed-43e8-93b5-62af4824a081', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'serial': 'd0b9cf06-70bc-407d-a438-a14a397c553d'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:53:58.007300 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98991) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 26 02:53:58.007470 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] opening encrypted volume /dev/dm-6 {{(pid=98991) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 26 02:53:58.041146 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:58.044624 np0000003683 nova-compute[98991]: WARNING os_brick.encryptors.luks [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:53:58.044872 np0000003683 nova-compute[98991]: INFO os_brick.encryptors.luks [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] /dev/dm-6 is not a valid LUKS device; formatting device for first use
Jun 26 02:53:58.045038 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98991) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 26 02:53:58.094599 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:58.095129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:58.365130 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:53:58.365620 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.334s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:58.365993 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:53:58.546004 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Object Instance<2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:53:58.546179 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'keypairs' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:53:58.597789 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:53:58.981176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:58.981306 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:58.981410 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:58.981502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:53:58.981603 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:2e:ea:a9, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:53:59.048671 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Object Instance<2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:53:59.052072 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:53:59.167093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:59.167402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:59.170200 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:53:59.170368 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Claim successful on node np0000003683
Jun 26 02:53:59.186112 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Creating config drive at /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config
Jun 26 02:53:59.190000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph13p2ym8 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:53:59.245688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph13p2ym8" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:53:59.634211 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:59.660311 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:59.664201 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:59.745524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:53:59.863722 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4b9992a-5914-471d-96b1-3c7ef5b2983f req-9bda2ca3-b4f7-4bf1-8ca6-90445dee4de2 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:53:59.864041 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4b9992a-5914-471d-96b1-3c7ef5b2983f req-9bda2ca3-b4f7-4bf1-8ca6-90445dee4de2 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:53:59.864494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4b9992a-5914-471d-96b1-3c7ef5b2983f req-9bda2ca3-b4f7-4bf1-8ca6-90445dee4de2 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:53:59.864494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d4b9992a-5914-471d-96b1-3c7ef5b2983f req-9bda2ca3-b4f7-4bf1-8ca6-90445dee4de2 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:53:59.864494 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d4b9992a-5914-471d-96b1-3c7ef5b2983f req-9bda2ca3-b4f7-4bf1-8ca6-90445dee4de2 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Processing event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:54:00.000851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:00.002466 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:00.004770 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:00.024628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:00.425919 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:54:00.426469 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442440.4260542, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:00.426736 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Started (Lifecycle Event)
Jun 26 02:54:00.428658 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:54:00.430543 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance spawned successfully.
Jun 26 02:54:00.430912 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:00.532807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:00.533206 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:00.542574 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1b33cc32-bcd4-42c2-afb9-cc5c796827b0 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.391s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:00.859768 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:00.860331 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:00.860989 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:00.862711 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:00.863372 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:00.863801 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:54:00.929369 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:00.944710 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ff62145-900f-4bb2-b221-15b890eb5462 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.029s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:00.962364 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:00.970197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:01.038000 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:01.345950 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:01.345950 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:54:01.397306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:01.397542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:01.472287 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442441.4719503, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:01.472789 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Paused (Lifecycle Event)
Jun 26 02:54:01.549592 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.382s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:01.550242 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:54:01.902261 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:01.956258 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:01.959507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:01.959507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:01.959507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:01.959507 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:01.959507 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-63c93b17-f084-466e-8432-a9e760acd9e4 req-07b53d81-2ca8-4507-b211-c26111698ff1 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received unexpected event network-vif-plugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with vm_state active and task_state None.
Jun 26 02:54:01.980707 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:01.983020 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442441.9828198, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:01.983321 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Resumed (Lifecycle Event)
Jun 26 02:54:02.060364 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:54:02.067702 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:54:02.067702 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:02.067702 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:02.164498 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02816c16bbcd47f5a1d15ca6d6377e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0501274670f84685b7449e324b329eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:54:02.283573 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:02.485839 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:02.489583 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:02.557717 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:54:02.723293 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Successfully created port: 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:54:02.913232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:03.014000 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:03.062753 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:54:03.306837 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Successfully updated port: 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:54:03.359375 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:03.359571 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing instance network info cache due to event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:03.359768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] Acquiring lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:03.360221 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] Acquired lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:03.360378 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing network info cache for port 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:03.809754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:03.863140 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:03.935128 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:04.013081 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:04.013292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:04.013456 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attaching volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b to /dev/vdd
Jun 26 02:54:04.055774 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:04.064776 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:04.069698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:54:04.072092 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:54:04.073338 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:54:04.074456 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Creating image(s)
Jun 26 02:54:04.076261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:04.077808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:04.079602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:04.080057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:04.080789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:04.100934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:04.152102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:54:04.152409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef'] 
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:04.164493 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating existing volume attachment record: bfb48401-e5c2-4a43-ae36-a2c665a31884 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:54:04.568273 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ba507395-090e-49e2-8154-9c38d0579596 req-c253581a-174a-4c47-8ee1-f5343ed8d8f9 service nova] Releasing lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:04.569166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquired lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:04.569493 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:54:04.727931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:54:04.727931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:04.727931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:04.728530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:04.728862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:54:04.745562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:04.746569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:04.747098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:04.747369 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:04.748314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:04.748684 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:04.764666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:04.764666 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:04.770413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:04.770413 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b] added
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:04.780945 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:04.781773 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:04.782005 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b] added
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:04.785938 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:04.786237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:04.786369 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:04.786614 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:04.865951 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] opening encrypted volume /dev/dm-6 {{(pid=98991) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 26 02:54:04.873014 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:04.875362 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:04.875734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:04.979534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.part --force-share --output=json" returned: 0 in 0.103s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:04.980133 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] 2afabee8-1ebb-45de-91b5-d295958af86b was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:54:04.980901 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:54:04.981282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.part /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.166983 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:05.174126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.part /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.converted" returned: 0 in 0.193s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.189314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.304642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8.converted --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.305327 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:05.305902 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:05.309231 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:05.311414 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.392398 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:05.396965 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.397409 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:05.398123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:05.398619 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:05.401262 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:05.401651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.497827 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.498351 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8,backing_fmt=raw /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.558039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8,backing_fmt=raw /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk 1073741824" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.558497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "d57e542382c8d8d9159e2c8edb49803bd2445dc8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:05.558811 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:05.596743 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating instance_info_cache with network_info: [{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:05.650417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d57e542382c8d8d9159e2c8edb49803bd2445dc8 --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:05.651073 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:54:05.651274 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Ensure instance console log exists: /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:54:05.651546 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:05.651749 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:05.651871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:05.782546 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:05.787191 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:05.796546 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:05.810897 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.823237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.826866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.845435 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.858792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.863386 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:05.917021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.50.100,3260]
Jun 26 02:54:05.917021 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:05.917021 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.932361 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.933046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.40.100,3260]
Jun 26 02:54:05.933046 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:05.933046 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.948073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.960834 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.962016 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:05.963580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:05.964011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:05.966757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('19', '-', '-', 0) found on session 169 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:05.966757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:05.975176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.976847 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:05.977996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:05.979269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('20', '-', '-', 0) found on session 170 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:05.979269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:05.992300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 169 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:05.993713 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:06.008284 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 170 and hctl ['20', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:06.100533 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Releasing lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:06.101846 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance network_info: |[{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:54:06.103977 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Start _get_guest_xml network_info=[{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='79fb6d07a886e807b4f55a66be658fc2',container_format='bare',created_at=2026-06-26T02:53:49Z,direct_url=<?>,disk_format='qcow2',id=2afabee8-1ebb-45de-91b5-d295958af86b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-429498323',owner='0501274670f84685b7449e324b329eb8',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-26T02:53:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': '2afabee8-1ebb-45de-91b5-d295958af86b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:54:06.113835 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:54:06.117217 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-861717398', uuid='f44cbb04-f745-49d7-9f82-e7dcde2d68e6'), owner=OwnerMeta(userid='02816c16bbcd47f5a1d15ca6d6377e09', username='tempest-TestStampPattern-1659297009-project-member', projectid='0501274670f84685b7449e324b329eb8', projectname='tempest-TestStampPattern-1659297009'), image=ImageMeta(id='2afabee8-1ebb-45de-91b5-d295958af86b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '0501274670f84685b7449e324b329eb8'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442446.115138) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:54:06.118276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:54:06.118715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:54:06.119706 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:54:06.119962 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:54:06.121387 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:54:06.122172 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='79fb6d07a886e807b4f55a66be658fc2',container_format='bare',created_at=2026-06-26T02:53:49Z,direct_url=<?>,disk_format='qcow2',id=2afabee8-1ebb-45de-91b5-d295958af86b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-429498323',owner='0501274670f84685b7449e324b329eb8',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-26T02:53:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:54:06.122172 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:54:06.122471 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:54:06.122648 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:54:06.122818 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:54:06.122966 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:54:06.123225 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:54:06.123382 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:54:06.123605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:54:06.123823 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:54:06.123947 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:54:06.142380 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-861717398',display_name='tempest-TestStampPattern-server-861717398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-861717398',id=65,image_ref='2afabee8-1ebb-45de-91b5-d295958af86b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-iv0fwt6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbed1f7d-1080-4781-aaca-03b672cb4168',image_min_disk='1',image_min_ram='0',image_owner_id='0501274670f84685b7449e324b329eb8',image_owner_project_name='tempest-TestStampPattern-1659297009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1659297009-project-member',image_user_id='02816c16bbcd47f5a1d15ca6d6377e09',network_allocated='True',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:03Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=f44cbb04-f745-49d7-9f82-e7dcde2d68e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:54:06.142380 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:06.143515 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:06.144697 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'pci_devices' on Instance uuid f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <uuid>f44cbb04-f745-49d7-9f82-e7dcde2d68e6</uuid>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <name>instance-00000041</name>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestStampPattern-server-861717398</nova:name>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:54:06</nova:creationTime>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:property name="img_owner_id">0501274670f84685b7449e324b329eb8</nova:property>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:user uuid="02816c16bbcd47f5a1d15ca6d6377e09">tempest-TestStampPattern-1659297009-project-member</nova:user>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:project uuid="0501274670f84685b7449e324b329eb8">tempest-TestStampPattern-1659297009</nova:project>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         <nova:port uuid="5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="serial">f44cbb04-f745-49d7-9f82-e7dcde2d68e6</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="uuid">f44cbb04-f745-49d7-9f82-e7dcde2d68e6</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.config"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:77:fb:01"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <target dev="tap5aa9aab8-17"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/console.log" append="off"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:54:06.647685 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Preparing to wait for external event network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-861717398',display_name='tempest-TestStampPattern-server-861717398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-861717398',id=65,image_ref='2afabee8-1ebb-45de-91b5-d295958af86b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-iv0fwt6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbed1f7d-1080-4781-aaca-03b672cb4168',image_min_disk='1',image_min_ram='0',image_owner_id='0501274670f84685b7449e324b329eb8',image_owner_project_name='tempest-TestStampPattern-1659297009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1659297009-project-member',image_user_id='02816c16bbcd47f5a1d15ca6d6377e09',network_allocated='True',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:03Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=f44cbb04-f745-49d7-9f82-e7dcde2d68e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:06.649986 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:06.650284 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:54:06.651290 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.651290 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:06.651290 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:54:06.651727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.651888 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b6a684c-d1c9-51e5-9796-8797796d5104', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:06.652653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.653576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:06.653999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.656839 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.656992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aa9aab8-17, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:06.657368 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5aa9aab8-17, col_values=(('qos', UUID('886b9310-66e2-4a4e-b350-957f724eb8d5')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:06.657570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5aa9aab8-17, col_values=(('external_ids', {'iface-id': '5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:fb:01', 'vm-uuid': 'f44cbb04-f745-49d7-9f82-e7dcde2d68e6'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:06.658294 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.660579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:06.664390 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:06.665356 np0000003683 nova-compute[98991]: INFO os_vif [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17')
Jun 26 02:54:07.009848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 170 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:07.010306 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:07.285215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.404953 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1521149999',display_name='tempest-TestVolumeBootPattern-server-1521149999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1521149999',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ueee7rzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:53:51Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=9804bb3e-2bed-43e8-93b5-62af4824a081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:54:07.405293 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:07.405830 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:07.406520 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 9804bb3e-2bed-43e8-93b5-62af4824a081 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:07.734907 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:54:07.762842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found WWN 330000000cbcd3290 for multipath device dm-7 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:54:07.764564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:07.764564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000cbcd3290', 'path': '/dev/dm-7', 'multipath_id': '330000000cbcd3290'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:07.764564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cbcd3290', 'path': '/dev/dm-7', 'multipath_id': '330000000cbcd3290'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:54:07.766054 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <uuid>9804bb3e-2bed-43e8-93b5-62af4824a081</uuid>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <name>instance-00000040</name>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1521149999</nova:name>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:53:53</nova:creationTime>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         <nova:port uuid="19428767-2826-454e-b432-e140cae158f7">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="serial">9804bb3e-2bed-43e8-93b5-62af4824a081</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="uuid">9804bb3e-2bed-43e8-93b5-62af4824a081</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/disk.config"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <alias name="ua-d0b9cf06-70bc-407d-a438-a14a397c553d"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <serial>d0b9cf06-70bc-407d-a438-a14a397c553d</serial>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:ba:23:44"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <target dev="tap19428767-28"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/console.log" append="off"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:54:07.909677 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Preparing to wait for external event network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1521149999',display_name='tempest-TestVolumeBootPattern-server-1521149999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1521149999',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ueee7rzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:53:51Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=9804bb3e-2bed-43e8-93b5-62af4824a081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:54:07.913982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.914469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42c690ff-e447-5d96-9aad-153868d77977', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:07.922763 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.923540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:07.930226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.932676 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.932868 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19428767-28, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:07.933212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19428767-28, col_values=(('qos', UUID('03380ef2-50dc-43b3-9142-b24d124f6824')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:07.933345 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19428767-28, col_values=(('external_ids', {'iface-id': '19428767-2826-454e-b432-e140cae158f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:23:44', 'vm-uuid': '9804bb3e-2bed-43e8-93b5-62af4824a081'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:07.934233 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.935696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:07.945627 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:07.946563 np0000003683 nova-compute[98991]: INFO os_vif [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28')
Jun 26 02:54:08.182778 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:08.183222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:08.183222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No VIF found with MAC fa:16:3e:77:fb:01, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:08.183620 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Using config drive
Jun 26 02:54:08.270848 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to attach volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <target dev="vdd" bus="virtio"/>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:54:08.272888 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:54:08.689338 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:08.803661 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Creating config drive at /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.config
Jun 26 02:54:08.807247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp346mz8av {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:08.865529 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp346mz8av" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:09.289574 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.324677 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.327540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.422113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.449005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.454697 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:09.463458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.463626 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.463726 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:ba:23:44, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:09.464252 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Using config drive
Jun 26 02:54:09.481979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-78bf7d3a-399c-4aac-bb4d-9eb2e5636665 req-33e84713-7bf3-40de-83ab-fddb74fd8b9d service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:09.482548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-78bf7d3a-399c-4aac-bb4d-9eb2e5636665 req-33e84713-7bf3-40de-83ab-fddb74fd8b9d service nova] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:09.482737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-78bf7d3a-399c-4aac-bb4d-9eb2e5636665 req-33e84713-7bf3-40de-83ab-fddb74fd8b9d service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:09.482871 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-78bf7d3a-399c-4aac-bb4d-9eb2e5636665 req-33e84713-7bf3-40de-83ab-fddb74fd8b9d service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:09.483004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-78bf7d3a-399c-4aac-bb4d-9eb2e5636665 req-33e84713-7bf3-40de-83ab-fddb74fd8b9d service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Processing event network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:54:09.923598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.923872 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.923969 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.924055 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.924155 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:09.924220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:2e:ea:a9, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:09.970370 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:10.061868 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442450.0614989, f44cbb04-f745-49d7-9f82-e7dcde2d68e6 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:10.062292 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:54:10.062423 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] VM Started (Lifecycle Event)
Jun 26 02:54:10.067426 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:54:10.072503 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance spawned successfully.
Jun 26 02:54:10.073127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:54:10.077637 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:10.077815 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:10.105409 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Creating config drive at /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/disk.config
Jun 26 02:54:10.109815 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6pd8hjy3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:10.168983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6pd8hjy3" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:10.565234 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:10.567814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:10.588888 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Took 6.51 seconds to spawn the instance on the hypervisor.
Jun 26 02:54:10.588888 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:10.600522 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:10.632078 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:10.716700 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:10.827524 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c93419b1-85a3-458c-8c50-1a4bdf0d83fb req-9cb78c76-2d85-4f15-89d7-b6f500256216 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:10.830124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c93419b1-85a3-458c-8c50-1a4bdf0d83fb req-9cb78c76-2d85-4f15-89d7-b6f500256216 service nova] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:10.830408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c93419b1-85a3-458c-8c50-1a4bdf0d83fb req-9cb78c76-2d85-4f15-89d7-b6f500256216 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:10.830741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c93419b1-85a3-458c-8c50-1a4bdf0d83fb req-9cb78c76-2d85-4f15-89d7-b6f500256216 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:10.830879 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c93419b1-85a3-458c-8c50-1a4bdf0d83fb req-9cb78c76-2d85-4f15-89d7-b6f500256216 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Processing event network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:54:10.992833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:10.994192 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:10.996015 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:11.018719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:11.070054 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:54:11.073494 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442451.070464, f44cbb04-f745-49d7-9f82-e7dcde2d68e6 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:11.073494 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] VM Paused (Lifecycle Event)
Jun 26 02:54:11.097575 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Took 12.00 seconds to build instance.
Jun 26 02:54:11.456930 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:54:11.459221 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:54:11.461277 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance spawned successfully.
Jun 26 02:54:11.461577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:54:11.492036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0bd32018-2367-43e4-9e29-773b3cbf66e1 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.479s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:11.543181 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:11.543796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:11.543796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:11.543796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:11.543939 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] No waiting events found dispatching network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:11.544010 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f0487e0f-e806-4a60-90c5-654ec80343e9 req-5f862083-657c-4e72-90f7-a856a557d76c service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received unexpected event network-vif-plugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e for instance with vm_state active and task_state None.
Jun 26 02:54:11.576049 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:11.578686 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442451.5784078, f44cbb04-f745-49d7-9f82-e7dcde2d68e6 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:11.578853 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] VM Resumed (Lifecycle Event)
Jun 26 02:54:11.599171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.504s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:11.976750 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:11.976924 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:11.977293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:11.977564 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:11.977846 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:11.978114 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:12.081206 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:12.087092 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:12.288959 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:12.485616 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Took 18.55 seconds to spawn the instance on the hypervisor.
Jun 26 02:54:12.485847 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:12.589495 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442452.589118, 9804bb3e-2bed-43e8-93b5-62af4824a081 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:12.589892 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] VM Started (Lifecycle Event)
Jun 26 02:54:12.924422 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:12.925604 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:12.926695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:12.926864 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:12.927029 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] No waiting events found dispatching network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:12.927188 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-422745e0-8d9d-444b-a21b-350ebfbd0dfe req-75c4edc2-7bc4-4406-950e-df6c2bb4c7d3 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received unexpected event network-vif-plugged-19428767-2826-454e-b432-e140cae158f7 for instance with vm_state active and task_state None.
Jun 26 02:54:12.944041 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:12.996430 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Took 25.69 seconds to build instance.
Jun 26 02:54:13.095792 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:13.099850 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:13.498376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-dcd19ff3-5428-42b8-91f4-d2404032b5aa tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.205s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:13.603105 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442453.6026995, 9804bb3e-2bed-43e8-93b5-62af4824a081 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:13.605433 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] VM Paused (Lifecycle Event)
Jun 26 02:54:13.708449 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:13.708745 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing instance network info cache due to event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:13.708954 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] Acquiring lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:13.709124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] Acquired lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:13.709279 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing network info cache for port 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:14.108601 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:14.112467 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442454.1101735, 9804bb3e-2bed-43e8-93b5-62af4824a081 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:14.112467 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] VM Resumed (Lifecycle Event)
Jun 26 02:54:14.214865 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:14.230465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:14.230714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:14.562002 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:14.605409 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:14.605888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:14.605888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:14.605888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:14.606031 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:14.608120 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Terminating instance
Jun 26 02:54:14.613784 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:14.616283 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:14.693037 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updated VIF entry in instance network info cache for port 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:54:14.693365 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating instance_info_cache with network_info: [{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:14.735460 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:54:15.111351 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:54:15.118449 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 26 02:54:15.143001 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.145792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.168012 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.170491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.195345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2a243425-1b33-46a8-b312-2ee391549013 req-57b1a7cc-4606-4451-9b4b-22a8e5807491 service nova] Releasing lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:15.197662 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.305068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:15.305692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:15.310197 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:54:15.310561 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Claim successful on node np0000003683
Jun 26 02:54:15.334954 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:15.335201 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:15.335374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:15.339668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:15.339668 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] No waiting events found dispatching network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:15.339668 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c889ece5-9641-4bbb-9266-407beada7230 req-5564f5f0-5ecc-4b7e-a0fe-30747f163f53 service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:15.435238 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.442844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.466788 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999641000999873 future=<Future at 0x72e27c33c0b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:15.467848 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998866189000182 future=<Future at 0x72e27c33c0b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:15.467930 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998378311000124 future=<Future at 0x72e27c33c0b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:15.471310 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Instance destroyed successfully.
Jun 26 02:54:15.471912 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 9804bb3e-2bed-43e8-93b5-62af4824a081 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:15.974493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1521149999',display_name='tempest-TestVolumeBootPattern-server-1521149999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1521149999',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:54:12Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ueee7rzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:54:13Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=9804bb3e-2bed-43e8-93b5-62af4824a081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:54:15.974968 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "19428767-2826-454e-b432-e140cae158f7", "address": "fa:16:3e:ba:23:44", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19428767-28", "ovs_interfaceid": "19428767-2826-454e-b432-e140cae158f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:15.975256 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:15.975518 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:54:15.977773 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.978127 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19428767-28, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:15.980782 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.980782 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:15.981696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.981894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03380ef2-50dc-43b3-9142-b24d124f6824) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:15.983516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.983516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:15.983516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:15.985710 np0000003683 nova-compute[98991]: INFO os_vif [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:23:44,bridge_name='br-int',has_traffic_filtering=True,id=19428767-2826-454e-b432-e140cae158f7,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19428767-28')
Jun 26 02:54:16.019804 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '9804bb3e-2bed-43e8-93b5-62af4824a081', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'serial': 'd0b9cf06-70bc-407d-a438-a14a397c553d'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:54:16.020493 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:54:16.020757 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:54:16.020946 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:54:16.021749 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x72e29c28cc80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '9804bb3e-2bed-43e8-93b5-62af4824a081', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'serial': 'd0b9cf06-70bc-407d-a438-a14a397c553d'} {{(pid=98991) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 26 02:54:16.022015 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors.luks [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] closing encrypted volume /dev/dm-8 {{(pid=98991) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
Jun 26 02:54:16.054138 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:54:16.054530 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:16.054757 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:16.055261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:16.055615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0b9cf06-70bc-407d-a438-a14a397c553d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:54:16.055774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:16.089502 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:54:16.090187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '166')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:16.091086 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '165')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:16.092034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c456520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:54:16.092263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:54:16.092839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 33000000066e4f076 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:54:16.134125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:16.189350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:16.256006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:54:16.256198 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:54:16.257445 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:54:16.269616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:54:16.269890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:54:16.285606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.324372 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.40.100,3260]
Jun 26 02:54:16.324372 np0000003683 nova-compute[98991]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:16.324372 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.345208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.357007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.398398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.50.100,3260]
Jun 26 02:54:16.398398 np0000003683 nova-compute[98991]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:16.398398 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.417412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:16.418503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:16.418659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (364ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:16.418774 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:54:16.419186 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Deleting instance files /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081_del
Jun 26 02:54:16.419663 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Deletion of /opt/stack/data/nova/instances/9804bb3e-2bed-43e8-93b5-62af4824a081_del complete
Jun 26 02:54:16.683071 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:16.683308 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:16.925663 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Took 1.81 seconds to destroy the instance on the hypervisor.
Jun 26 02:54:16.927156 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:54:16.927530 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:54:16.927638 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:54:16.928115 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:17.011556 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:17.186187 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:17.288600 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:17.402535 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:17.402915 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] Acquiring lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:17.403030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:17.403177 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:17.403300 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] No waiting events found dispatching network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:17.403458 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-unplugged-19428767-2826-454e-b432-e140cae158f7 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:17.403603 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Received event network-vif-deleted-19428767-2826-454e-b432-e140cae158f7 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:17.403719 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Neutron deleted interface 19428767-2826-454e-b432-e140cae158f7; detaching it from the instance and deleting it from the info cache
Jun 26 02:54:17.406105 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-272d17e6-1976-47fe-8da7-c73aeeefee54 req-9ebb9895-b315-451d-af99-c1cf0310bcaa service nova] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Detach interface failed, port_id=19428767-2826-454e-b432-e140cae158f7, reason: Instance 9804bb3e-2bed-43e8-93b5-62af4824a081 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:54:17.692711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.387s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:17.693287 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:54:17.747729 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:18.198970 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:54:18.202505 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:54:18.202505 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:18.202505 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:18.249695 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Took 1.32 seconds to deallocate network for instance.
Jun 26 02:54:18.298652 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145815cb362e40ad95db2c64431821bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87599dd62cac4c0d9bfad984dc67bf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:54:18.700460 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:54:18.748332 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Successfully created port: ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:54:18.796829 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:54:19.205582 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:54:19.249979 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Successfully updated port: ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:54:19.296486 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-changed-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:19.296630 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Refreshing instance network info cache due to event network-changed-ed2547b7-d704-482a-9dfb-dfade87dc165. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:19.296831 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] Acquiring lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:19.296940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] Acquired lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:19.297039 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Refreshing network info cache for port ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:19.304011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:19.304203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:19.649173 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:19.649392 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:19.754724 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:19.799049 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:19.873724 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:19.990404 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:20.151838 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:20.212067 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:54:20.212971 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:54:20.213327 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Creating image(s)
Jun 26 02:54:20.213903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:20.214059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:20.214872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:20.215489 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:20.218615 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:20.219702 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:20.309548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:20.310007 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:20.310584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:20.311174 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:20.314851 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:54:20.315740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:20.421720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:20.422193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:20.488102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk 1073741824" returned: 0 in 0.066s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:20.488554 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:20.488846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:20.507897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-72243c92-67de-4cad-86b7-65004841723d req-5abffcb5-9db1-4cc4-8df9-22c21cce7475 service nova] Releasing lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:20.509357 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquired lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:20.510630 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:54:20.605932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.117s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:20.606533 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:54:20.607003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:20.662190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.357s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:20.720365 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 9804bb3e-2bed-43e8-93b5-62af4824a081
Jun 26 02:54:20.809578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:20.809976 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Cannot resize image /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:54:20.810554 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:54:20.810746 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Ensure instance console log exists: /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:54:20.811055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:20.811323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:20.811543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:20.983435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:21.068424 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:21.239767 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:21.386768 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updating instance_info_cache with network_info: [{"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:21.732278 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e7f03c0-425c-40e2-a171-d4b14c24a46a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "9804bb3e-2bed-43e8-93b5-62af4824a081" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.127s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:21.889093 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Releasing lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:21.889491 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance network_info: |[{"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:54:21.891490 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Start _get_guest_xml network_info=[{"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:54:21.896061 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:54:21.897665 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-673388553', uuid='6cc2f43d-80ff-4086-ab53-a7b0458715e6'), owner=OwnerMeta(userid='145815cb362e40ad95db2c64431821bc', username='tempest-VolumeMultiattachTests-190007800-project-member', projectid='87599dd62cac4c0d9bfad984dc67bf67', projectname='tempest-VolumeMultiattachTests-190007800'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442461.8971941) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:54:21.898894 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:54:21.899308 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:54:21.900393 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:54:21.900611 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:54:21.901924 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:54:21.902315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:54:21.902489 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:54:21.902608 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:54:21.902763 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:54:21.902855 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:54:21.902968 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:54:21.903525 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:54:21.903698 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:54:21.903835 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:54:21.904015 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:54:21.904162 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:54:21.915597 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-673388553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-673388553',id=66,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-n9k8038x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=6cc2f43d-80ff-4086-ab53-a7b0458715e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:54:21.915813 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:21.916518 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:21.917515 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:22.290155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <uuid>6cc2f43d-80ff-4086-ab53-a7b0458715e6</uuid>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <name>instance-00000042</name>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumeMultiattachTests-server-673388553</nova:name>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:54:21</nova:creationTime>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:user uuid="145815cb362e40ad95db2c64431821bc">tempest-VolumeMultiattachTests-190007800-project-member</nova:user>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:project uuid="87599dd62cac4c0d9bfad984dc67bf67">tempest-VolumeMultiattachTests-190007800</nova:project>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         <nova:port uuid="ed2547b7-d704-482a-9dfb-dfade87dc165">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="serial">6cc2f43d-80ff-4086-ab53-a7b0458715e6</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="uuid">6cc2f43d-80ff-4086-ab53-a7b0458715e6</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.config"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:6e:25:dd"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <target dev="taped2547b7-d7"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/console.log" append="off"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:54:22.420585 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Preparing to wait for external event network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-673388553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-673388553',id=66,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-n9k8038x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=6cc2f43d-80ff-4086-ab53-a7b0458715e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:54:22.423967 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.424545 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:22.424695 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:54:22.425663 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.425859 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec61c200-d204-5da2-bda3-42911d0cadb6', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:22.426658 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.427375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:22.427798 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.429910 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.430020 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped2547b7-d7, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:22.430318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped2547b7-d7, col_values=(('qos', UUID('d101a4b1-23b4-408a-89e6-822dcdded88b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:22.430511 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped2547b7-d7, col_values=(('external_ids', {'iface-id': 'ed2547b7-d704-482a-9dfb-dfade87dc165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:25:dd', 'vm-uuid': '6cc2f43d-80ff-4086-ab53-a7b0458715e6'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:22.431378 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.432492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:22.441104 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:22.442345 np0000003683 nova-compute[98991]: INFO os_vif [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7')
Jun 26 02:54:23.961502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:23.961921 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:23.961921 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:6e:25:dd, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:23.962124 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Using config drive
Jun 26 02:54:24.468576 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:24.596254 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Creating config drive at /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.config
Jun 26 02:54:24.600368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgdr7ww10 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:24.653671 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgdr7ww10" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:25.101634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:25.130327 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:25.132339 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:25.263243 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:25.330608 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0c983255-6fb7-49eb-a1dc-1a62b61a8b8b req-febc8365-a76b-4e0a-8110-4bbc1a3685cc service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:25.330805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c983255-6fb7-49eb-a1dc-1a62b61a8b8b req-febc8365-a76b-4e0a-8110-4bbc1a3685cc service nova] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:25.331068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c983255-6fb7-49eb-a1dc-1a62b61a8b8b req-febc8365-a76b-4e0a-8110-4bbc1a3685cc service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:25.331286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0c983255-6fb7-49eb-a1dc-1a62b61a8b8b req-febc8365-a76b-4e0a-8110-4bbc1a3685cc service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:25.331887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0c983255-6fb7-49eb-a1dc-1a62b61a8b8b req-febc8365-a76b-4e0a-8110-4bbc1a3685cc service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Processing event network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:54:25.436757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:25.438615 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:26.014425 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442466.013913, 6cc2f43d-80ff-4086-ab53-a7b0458715e6 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:26.014773 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] VM Started (Lifecycle Event)
Jun 26 02:54:26.018547 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:54:26.023330 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:54:26.025812 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance spawned successfully.
Jun 26 02:54:26.026292 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:54:26.521458 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:26.530144 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:26.536857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:26.536939 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:26.537303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:26.537576 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:26.537834 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:26.538069 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:27.036133 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:54:27.036576 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442467.0362952, 6cc2f43d-80ff-4086-ab53-a7b0458715e6 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:27.036768 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] VM Paused (Lifecycle Event)
Jun 26 02:54:27.044843 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Took 6.83 seconds to spawn the instance on the hypervisor.
Jun 26 02:54:27.044843 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:27.299009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:27.389063 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:27.389251 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:27.389463 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:27.389643 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:27.389794 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] No waiting events found dispatching network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:27.389924 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-257506f8-c94d-4982-b9a2-c460482ba9da req-5d88b1fa-988b-4fb5-a9ac-e30ba29004f0 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received unexpected event network-vif-plugged-ed2547b7-d704-482a-9dfb-dfade87dc165 for instance with vm_state active and task_state None.
Jun 26 02:54:27.441876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:27.541322 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:27.546225 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442467.545121, 6cc2f43d-80ff-4086-ab53-a7b0458715e6 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:27.546225 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] VM Resumed (Lifecycle Event)
Jun 26 02:54:27.553527 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Took 12.32 seconds to build instance.
Jun 26 02:54:27.637117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:27.637369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:28.052247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:28.054919 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:28.057068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.826s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:28.139493 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:54:28.714432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:28.714790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:28.719000 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:54:28.719203 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Claim successful on node np0000003683
Jun 26 02:54:28.982508 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:28.982663 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing instance network info cache due to event network-changed-07d56f48-31a3-4499-9e44-ec684a89c432. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:28.982838 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] Acquiring lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:28.982964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] Acquired lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:28.983025 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Refreshing network info cache for port 07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:29.485172 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:29.769320 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:29.932399 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updated VIF entry in instance network info cache for port 07d56f48-31a3-4499-9e44-ec684a89c432. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:54:29.932712 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating instance_info_cache with network_info: [{"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:30.123915 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:30.124230 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:30.435145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3ceeb82b-4533-4c38-aca0-19f252a77b29 req-5c55ae42-5689-4c4f-b45a-a59399588b54 service nova] Releasing lock "refresh_cache-a5d387b7-a9ad-4a06-8504-93a902496c23" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:30.466752 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004442579997885332 future=<Future at 0x72e27c33c0b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:30.467257 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Emitting event <LifecycleEvent: 1782442455.466188, 9804bb3e-2bed-43e8-93b5-62af4824a081 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:30.467423 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:30.467668 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] VM Stopped (Lifecycle Event)
Jun 26 02:54:30.626861 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:30.970458 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 9804bb3e-2bed-43e8-93b5-62af4824a081] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:31.057844 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-changed-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:31.057979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Refreshing instance network info cache due to event network-changed-ed2547b7-d704-482a-9dfb-dfade87dc165. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:31.058206 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] Acquiring lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:31.058366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] Acquired lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:31.058546 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Refreshing network info cache for port ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:31.134407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.419s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:31.135199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:54:31.560960 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:31.642054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:54:31.642054 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:54:31.642338 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:31.643032 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:31.745352 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:54:31.912766 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:32.034142 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updated VIF entry in instance network info cache for port ed2547b7-d704-482a-9dfb-dfade87dc165. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:54:32.034611 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updating instance_info_cache with network_info: [{"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:32.147153 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:54:32.188770 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Successfully created port: 00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:54:32.303305 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:32.453331 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:32.536491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-177f5d59-ecc2-4958-9d61-5e38a36ee6fa req-179a66b3-18ac-4ea6-a3cf-1e1c4d23a86d service nova] Releasing lock "refresh_cache-6cc2f43d-80ff-4086-ab53-a7b0458715e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:32.654302 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:54:32.708816 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Successfully updated port: 00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:54:32.773134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-changed-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:32.773548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Refreshing instance network info cache due to event network-changed-00da51f4-e338-413a-a5ee-efd2fe10754d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:32.773698 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] Acquiring lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:32.773819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] Acquired lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:32.773948 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Refreshing network info cache for port 00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:33.155629 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Booting with volume 6139f634-bf14-4896-b77a-8295e043bacc at /dev/vda
Jun 26 02:54:33.192645 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:33.203256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:54:33.210889 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:33.223880 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:33.276902 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:33.279595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:54:33.281391 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:54:33.293188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:54:33.294310 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef', 'fe80::fc16:3eff:fe77:fb01', 'fe80::fc16:3eff:fe6e:25dd'] 
Jun 26 02:54:33.294439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:54:33.297550 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:54:33.297778 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:33.297957 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updating existing volume attachment record: 37e8f9fb-6609-423f-be1b-9627504a3891 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:54:33.346103 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:33.514349 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:34.016964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-137186d0-c896-4f93-b685-ad4b22af08e3 req-082f5139-ee3a-4b75-82f2-5d8aa1be5742 service nova] Releasing lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:34.018498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:34.018498 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:54:34.585886 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:54:34.733536 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:34.870929 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updating instance_info_cache with network_info: [{"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:35.372930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:35.373219 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance network_info: |[{"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:54:35.399596 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:54:35.401096 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:54:35.401408 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Creating image(s)
Jun 26 02:54:35.401811 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:54:35.401984 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:54:35.402291 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:35.402559 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:35.402715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:35.403258 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Start _get_guest_xml network_info=[{"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '37e8f9fb-6609-423f-be1b-9627504a3891', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8e6a556d-6113-49db-93ab-8442ceba5275', 'attached_at': '', 'detached_at': '', 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'serial': '6139f634-bf14-4896-b77a-8295e043bacc'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:54:35.408401 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:54:35.409741 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2080187697', uuid='8e6a556d-6113-49db-93ab-8442ceba5275'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442475.4093447) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:54:35.411273 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:54:35.411743 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:54:35.412812 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:54:35.413028 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:54:35.414129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:54:35.414455 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:54:35.414648 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:54:35.414777 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:54:35.415665 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:54:35.415665 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:54:35.416968 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:54:35.416968 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:54:35.417868 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:54:35.418033 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:54:35.418192 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:54:35.418436 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:54:35.434294 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:54:35.434727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:35.434891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:35.435338 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:35.435721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:54:35.450145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:35.450627 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:35.451148 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:35.451364 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:35.451848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:35.452058 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:35.466663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:35.466663 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:35.472499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:35.472499 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc] added
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:35.482771 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:35.482987 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:35.483100 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:35.483257 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc] added
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:35.487016 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:35.487570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:35.487570 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:35.487570 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.765959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.50.100,3260]
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.40.100,3260]
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('15', '-', '-', 0) found on session 174 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:36.779345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:36.786059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('17', '-', '-', 0) found on session 175 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:36.786059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:36.786059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 174 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:36.786059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:36.786059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 175 and hctl ['17', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:37.305719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:37.455885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:37.673790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 175 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:37.674001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:38.468959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 33000000014e72ab8 for multipath device dm-6 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:54:38.469455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:38.469455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000014e72ab8', 'path': '/dev/dm-6', 'multipath_id': '33000000014e72ab8'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:38.469649 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014e72ab8', 'path': '/dev/dm-6', 'multipath_id': '33000000014e72ab8'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:54:38.635216 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-changed-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:38.635404 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing instance network info cache due to event network-changed-b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:38.635558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] Acquiring lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:38.635677 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] Acquired lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:38.635787 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Refreshing network info cache for port b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:38.977048 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080187697',display_name='tempest-TestVolumeBootPattern-server-2080187697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-2080187697',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmaifaYHeXEZyr88EUZDGvp0f4wjPNTGZETWPM2LBKnj7TX121SxnNOFGDpvdaobUG8L8sUI7IR8Sk+uQ1YyIKSSwENgizLN+ZBoXr7Eul7xYyqA+oC4AIQxzQ6Sr7WCA==',key_name='tempest-keypair-1925457615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-j2l606jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=8e6a556d-6113-49db-93ab-8442ceba5275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:54:38.977332 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:38.977938 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:38.978635 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6a556d-6113-49db-93ab-8442ceba5275 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:39.137710 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:39.169957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:39.170233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:39.170519 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:39.170716 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:39.170881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:39.177190 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Terminating instance
Jun 26 02:54:39.453366 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <uuid>8e6a556d-6113-49db-93ab-8442ceba5275</uuid>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <name>instance-00000043</name>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-2080187697</nova:name>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:54:35</nova:creationTime>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         <nova:port uuid="00da51f4-e338-413a-a5ee-efd2fe10754d">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="serial">8e6a556d-6113-49db-93ab-8442ceba5275</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="uuid">8e6a556d-6113-49db-93ab-8442ceba5275</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/disk.config"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <alias name="ua-6139f634-bf14-4896-b77a-8295e043bacc"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-6"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <serial>6139f634-bf14-4896-b77a-8295e043bacc</serial>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:92:91:5c"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <target dev="tap00da51f4-e3"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/console.log" append="off"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:54:39.482723 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Preparing to wait for external event network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080187697',display_name='tempest-TestVolumeBootPattern-server-2080187697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-2080187697',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmaifaYHeXEZyr88EUZDGvp0f4wjPNTGZETWPM2LBKnj7TX121SxnNOFGDpvdaobUG8L8sUI7IR8Sk+uQ1YyIKSSwENgizLN+ZBoXr7Eul7xYyqA+oC4AIQxzQ6Sr7WCA==',key_name='tempest-keypair-1925457615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-j2l606jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=8e6a556d-6113-49db-93ab-8442ceba5275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:54:39.484641 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:39.484940 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:39.485112 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:54:39.485540 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.485823 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:39.486105 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:54:39.486914 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.487170 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c75e21a1-84d7-58e4-96bd-0720ba7c5c60', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:39.490165 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.491121 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:39.493432 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.495679 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.495848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00da51f4-e3, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:39.496313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00da51f4-e3, col_values=(('qos', UUID('89827df4-b53f-4580-812d-d2afaf2c6f80')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:39.496489 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00da51f4-e3, col_values=(('external_ids', {'iface-id': '00da51f4-e338-413a-a5ee-efd2fe10754d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:91:5c', 'vm-uuid': '8e6a556d-6113-49db-93ab-8442ceba5275'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:39.497993 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.500745 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:39.503969 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.504941 np0000003683 nova-compute[98991]: INFO os_vif [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3')
Jun 26 02:54:39.618795 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updated VIF entry in instance network info cache for port b7b999a4-0155-4154-9107-2c63992903ec. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:54:39.619537 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [{"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:39.681053 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:54:39.722949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.739714 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.748203 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.778042 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:39.903759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:39.904604 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:39.904809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:39.905145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:39.905628 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:39.905774 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b78ccd6-213e-4f53-b62d-8a222d57a350 req-1c1ee6d0-9e5e-4123-a3ef-dc3771610f68 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:40.031448 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999710480999966 future=<Future at 0x72e29e7aa300 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:40.031448 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999364637000326 future=<Future at 0x72e29e7aa300 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:40.031942 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99911985100016 future=<Future at 0x72e29e7aa300 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:40.035627 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Instance destroyed successfully.
Jun 26 02:54:40.036170 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lazy-loading 'resources' on Instance uuid 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:40.121820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-931e56dd-3ab5-4b77-a8e8-e63d0ecb8d3c req-0bd51b28-263a-4953-8a20-cc9cf1c38eed service nova] Releasing lock "refresh_cache-2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:40.538632 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995686116',display_name='tempest-TestShelveInstance-server-1995686116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testshelveinstance-server-1995686116',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm0ZDrs8Zw8sSSdJASOXnbEcwznd5W02ax34C1E1I0VPEpJSnoLmlusI+l+dRaSbzCrwpvGWwC+mjdRSAFE6gtTqBVwUXUofC5tSUpniGj3B/xEovZbiePKWMjCs9v55Q==',key_name='tempest-TestShelveInstance-113486237',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:54:00Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='988d5ab3adc04c35abcbeada86625022',ramdisk_id='',reservation_id='r-dsu94008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-816092709',owner_user_name='tempest-TestShelveInstance-816092709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:54:00Z,user_data=None,user_id='5e067d2b47da4bb1a1457fa0ad72628f',uuid=2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:54:40.539218 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converting VIF {"id": "b7b999a4-0155-4154-9107-2c63992903ec", "address": "fa:16:3e:b6:73:a3", "network": {"id": "4e75fe1f-d385-4d2c-b6dc-90266973e412", "bridge": "br-int", "label": "tempest-TestShelveInstance-1350684471-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "988d5ab3adc04c35abcbeada86625022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b999a4-01", "ovs_interfaceid": "b7b999a4-0155-4154-9107-2c63992903ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:40.539341 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:40.539573 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:54:40.540903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.541151 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b999a4-01, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:40.542215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.542940 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:40.548393 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.549249 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.549432 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=231b8dde-465a-46d5-bc68-b42c3d093a0d) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:40.550015 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.550494 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:40.555215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:40.557019 np0000003683 nova-compute[98991]: INFO os_vif [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:73:a3,bridge_name='br-int',has_traffic_filtering=True,id=b7b999a4-0155-4154-9107-2c63992903ec,network=Network(4e75fe1f-d385-4d2c-b6dc-90266973e412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b999a4-01')
Jun 26 02:54:40.558582 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:54:40.558852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:40.558966 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:40.559322 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:40.559616 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f12a25be-e0f3-4e2b-b8f2-4744459a3903', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:54:40.559730 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:40.590512 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:40.590835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:54:40.591098 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:40.592025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:40.593220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c3740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:54:40.593398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Removing multipathed devices sdi, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:54:40.593610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Flush multipath device 33000000053038c57 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:54:40.656728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:40.712357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:40.769778 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Checking to see if SCSI volumes sdi, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:54:40.769963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] SCSI volumes sdi, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:54:40.771049 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Checking to see if device paths {'sdi', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:54:40.782661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Device paths {'sdi', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:54:40.782895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:54:40.807014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.843379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260]
Jun 26 02:54:40.843379 np0000003683 nova-compute[98991]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:40.843379 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.864889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.877498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.929750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260]
Jun 26 02:54:40.929750 np0000003683 nova-compute[98991]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:40.929750 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.948971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:40.949287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:40.949417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] <== disconnect_volume: return (390ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:40.949613 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:54:40.949891 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deleting instance files /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294_del
Jun 26 02:54:40.950467 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deletion of /opt/stack/data/nova/instances/2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294_del complete
Jun 26 02:54:41.024517 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:41.024687 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:41.024820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:92:91:5c, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:41.025255 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Using config drive
Jun 26 02:54:41.459291 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Took 1.78 seconds to destroy the instance on the hypervisor.
Jun 26 02:54:41.459835 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:54:41.460030 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:54:41.460168 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:54:41.460360 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:41.533707 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:41.572496 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:41.676798 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Creating config drive at /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/disk.config
Jun 26 02:54:41.682149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp58q38sa {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:41.740926 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp58q38sa" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:41.848925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-925bee3f-e5a2-49fe-8fbd-9029f94bfb00 req-15e5b170-52f6-467a-ad77-ef49c721862a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-deleted-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:41.850131 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-925bee3f-e5a2-49fe-8fbd-9029f94bfb00 req-15e5b170-52f6-467a-ad77-ef49c721862a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Neutron deleted interface b7b999a4-0155-4154-9107-2c63992903ec; detaching it from the instance and deleting it from the info cache
Jun 26 02:54:41.854895 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-925bee3f-e5a2-49fe-8fbd-9029f94bfb00 req-15e5b170-52f6-467a-ad77-ef49c721862a service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Detach interface failed, port_id=b7b999a4-0155-4154-9107-2c63992903ec, reason: Instance 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:54:41.970169 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:41.970492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] Acquiring lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:41.970737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:41.970983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:41.971149 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] No waiting events found dispatching network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:41.971285 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9ac6ac2b-4cd4-4ce9-a570-22b96c0c317c req-0574d112-4859-4a2f-b8e1-1c46a51f69d0 service nova] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Received event network-vif-unplugged-b7b999a4-0155-4154-9107-2c63992903ec for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:42.188400 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.189964 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.214800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.218572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.293337 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:42.305660 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.310968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.525109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.528661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.549541 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:42.795836 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Took 1.34 seconds to deallocate network for instance.
Jun 26 02:54:42.937656 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442482.9372494, 8e6a556d-6113-49db-93ab-8442ceba5275 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:42.937943 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] VM Started (Lifecycle Event)
Jun 26 02:54:43.346832 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:54:43.349300 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Deleting volume: f12a25be-e0f3-4e2b-b8f2-4744459a3903 {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:54:43.440494 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:43.443289 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442483.4427626, 8e6a556d-6113-49db-93ab-8442ceba5275 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:43.443374 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] VM Paused (Lifecycle Event)
Jun 26 02:54:43.893727 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:43.895503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:43.945549 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:43.947330 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:44.030089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:44.030541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:44.030695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:44.030824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:44.030947 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Processing event network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:54:44.031078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:44.031219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:44.031624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:44.031624 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:44.031809 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] No waiting events found dispatching network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:44.031935 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-5f1a8f07-e64e-47cc-846c-0910cf565ce1 req-34d91a83-6e01-4d32-8799-9c67387eddf1 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received unexpected event network-vif-plugged-00da51f4-e338-413a-a5ee-efd2fe10754d for instance with vm_state building and task_state spawning.
Jun 26 02:54:44.032515 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:54:44.035404 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:54:44.039256 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance spawned successfully.
Jun 26 02:54:44.039530 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:54:44.289619 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:44.289619 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:44.449665 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:54:44.449943 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442484.449706, 8e6a556d-6113-49db-93ab-8442ceba5275 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:44.450130 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] VM Resumed (Lifecycle Event)
Jun 26 02:54:44.545802 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.545932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.546204 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.546415 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.546643 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.546857 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:54:44.792050 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:44.870363 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:44.870595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:44.952779 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:44.954817 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:54:45.120167 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Took 9.72 seconds to spawn the instance on the hypervisor.
Jun 26 02:54:45.120355 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:45.298977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.404s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:45.355939 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Deleted allocations for instance 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294
Jun 26 02:54:45.373045 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Detaching volume 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae
Jun 26 02:54:45.417156 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Attempting to driver detach volume 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae from mountpoint /dev/vdb
Jun 26 02:54:45.426129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found disk vdb by alias ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:54:45.427276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Found disk vdb by alias ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:54:45.427337 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Attempting to detach device vdb from instance 6a8fd917-0209-4446-b631-a83c282ef124 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <alias name="ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae"/>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <serial>9d49b35d-ed83-4b48-8eaa-e04ae16c4aae</serial>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:54:45.427590 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:54:45.436775 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully detached device vdb from instance 6a8fd917-0209-4446-b631-a83c282ef124 from the persistent domain config.
Jun 26 02:54:45.436957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] (1/8): Attempting to detach device vdb with device alias ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae from instance 6a8fd917-0209-4446-b631-a83c282ef124 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <alias name="ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae"/>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <serial>9d49b35d-ed83-4b48-8eaa-e04ae16c4aae</serial>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:54:45.437228 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:54:45.457363 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:54:45.551617 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:45.640895 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Took 16.99 seconds to build instance.
Jun 26 02:54:45.946563 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442485.946181, 6a8fd917-0209-4446-b631-a83c282ef124 => ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:54:45.947839 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae for instance 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:54:45.950898 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully detached device vdb from instance 6a8fd917-0209-4446-b631-a83c282ef124 from the live domain config.
Jun 26 02:54:45.955529 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:54:45.955875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:45.956011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:45.956407 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:45.956774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:54:45.956927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:45.985279 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:45.985642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:54:45.985879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:45.986914 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:54:45.987909 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a0d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'): ({'sdh'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:54:45.988134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Removing multipathed devices sdh, sdg {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:54:45.988388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Flush multipath device 330000000ea19899d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:54:46.018160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:46.087637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:54:46.142345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.505s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:46.144856 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:54:46.145021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:54:46.146009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:54:46.160389 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:54:46.160666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:54:46.174732 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.209829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.40.100,3260]
Jun 26 02:54:46.209829 np0000003683 nova-compute[98991]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:46.209829 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.231541 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.245043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.282609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.50.100,3260]
Jun 26 02:54:46.282609 np0000003683 nova-compute[98991]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:46.282609 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.303701 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:46.303920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:46.304038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] <== disconnect_volume: return (348ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:46.304153 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:54:46.365283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-82d581ca-7ce8-49ad-82b6-c212a3ab3e38 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Lock "2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.195s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:46.859651 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'flavor' on Instance uuid 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:47.018358 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-changed-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:47.018841 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Refreshing instance network info cache due to event network-changed-00da51f4-e338-413a-a5ee-efd2fe10754d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:54:47.019047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] Acquiring lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:54:47.019195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] Acquired lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:54:47.019347 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Refreshing network info cache for port 00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:54:47.306644 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:47.521461 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:47.864993 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cf2cb351-817c-4009-bbd5-eae86d23ffd3 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.994s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:47.899624 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:48.032358 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updated VIF entry in instance network info cache for port 00da51f4-e338-413a-a5ee-efd2fe10754d. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:54:48.032715 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updating instance_info_cache with network_info: [{"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:48.084261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:48.084452 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:48.084651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:48.084791 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:48.084918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:48.086975 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Terminating instance
Jun 26 02:54:48.534229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fde2b320-a0eb-4859-aba2-2f1bc798a128 req-e305b20c-9598-4bbf-a63b-b1130944e17a service nova] Releasing lock "refresh_cache-8e6a556d-6113-49db-93ab-8442ceba5275" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:54:48.590432 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:54:48.609741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:48.632227 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:48.635340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:48.657038 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:48.761523 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:48.761733 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:48.761902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:48.763899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:48.764031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] No waiting events found dispatching network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:48.764150 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1afea33-2b86-447a-a85f-b7e0b5e864ae req-b6bb6ec0-8fdd-465f-9c6b-aad6e93c413b service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:48.932902 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999734354999873 future=<Future at 0x72e29c232cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:48.936309 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Instance destroyed successfully.
Jun 26 02:54:48.937520 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lazy-loading 'resources' on Instance uuid 6a8fd917-0209-4446-b631-a83c282ef124 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:49.124056 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:49.441508 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-984607456',display_name='tempest-VolumesBackupsTest-instance-984607456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumesbackupstest-instance-984607456',id=62,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIzRul4EHkAdReqfFCDMF+Ofc+hS5rpwOAagJNfBeJscg2vVDVAnzrUINXHofr5urI1TO3pkv2BuNnK0m8jONKO6fd8hiQyZ3ipj04M9tponF9Co/IcWwYqaT/GPRJ5yg==',key_name='tempest-keypair-1691046292',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:59Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c05f689c58a04254b3930f0cc279148c',ramdisk_id='',reservation_id='r-ga2hke0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1738581805',owner_user_name='tempest-VolumesBackupsTest-1738581805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f08f0507eec40189b858129b4cc7fd1',uuid=6a8fd917-0209-4446-b631-a83c282ef124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:54:49.441508 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converting VIF {"id": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "address": "fa:16:3e:de:7f:47", "network": {"id": "114dae05-2395-430b-b30a-5fdbc6ab648b", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2105540554-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c05f689c58a04254b3930f0cc279148c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1d3294-45", "ovs_interfaceid": "7a1d3294-4501-4bcd-b52a-c3c45a8792a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:54:49.441508 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:54:49.441508 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:54:49.443002 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:49.443316 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a1d3294-45, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:49.444497 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:49.445577 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:49.449109 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:49.449295 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f8b848c-1ba2-41cd-8768-83acf2ec7e07) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:54:49.449832 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:49.450488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:54:49.452764 np0000003683 nova-compute[98991]: INFO os_vif [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:7f:47,bridge_name='br-int',has_traffic_filtering=True,id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4,network=Network(114dae05-2395-430b-b30a-5fdbc6ab648b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1d3294-45')
Jun 26 02:54:49.453212 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Deleting instance files /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124_del
Jun 26 02:54:49.454447 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Deletion of /opt/stack/data/nova/instances/6a8fd917-0209-4446-b631-a83c282ef124_del complete
Jun 26 02:54:49.964345 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:54:49.964748 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:54:49.965234 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:54:49.965353 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:54:49.965587 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:49.974341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:49.974566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:50.064740 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:54:50.478076 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:50.827714 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:50.827934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] Acquiring lock "6a8fd917-0209-4446-b631-a83c282ef124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:50.828147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:50.828321 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] Lock "6a8fd917-0209-4446-b631-a83c282ef124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:50.828495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] No waiting events found dispatching network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:54:50.828655 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-unplugged-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:54:50.828806 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Received event network-vif-deleted-7a1d3294-4501-4bcd-b52a-c3c45a8792a4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:54:50.828951 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Neutron deleted interface 7a1d3294-4501-4bcd-b52a-c3c45a8792a4; detaching it from the instance and deleting it from the info cache
Jun 26 02:54:50.831877 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0d74e1c1-9783-4765-9b45-b29712c4b828 req-f6af9a8d-e768-44d4-a351-f394458c91c0 service nova] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Detach interface failed, port_id=7a1d3294-4501-4bcd-b52a-c3c45a8792a4, reason: Instance 6a8fd917-0209-4446-b631-a83c282ef124 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:54:50.882986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:50.967599 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:54:51.469846 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Took 1.50 seconds to deallocate network for instance.
Jun 26 02:54:51.483402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:51.975630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:51.975777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:52.311184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:52.315209 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:52.315407 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:52.574654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:52.575111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:52.575111 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Attaching volume 28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da to /dev/vdb
Jun 26 02:54:52.624827 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:52.638107 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:54:52.661266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:52.706573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:54:52.706782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:54:52.718022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:54:52.719108 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe77:fb01', 'fe80::fc16:3eff:fe6e:25dd', 'fe80::fc16:3eff:fe92:915c', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:54:52.719294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:54:52.719294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:54:52.719640 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:52.719866 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating existing volume attachment record: 0e528281-4b29-4cee-88e0-d0dc32ad283e {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:54:52.818629 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:54:53.285782 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:54:53.286267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:54:53.286454 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:53.287168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:53.287461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:54:53.299649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:53.300112 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:53.300281 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:53.300919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:54:53.303376 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:54:53.303701 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:53.315076 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:53.315076 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:53.319658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:54:53.319658 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:53.330310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.353s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da] added
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:53.336423 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:53.337033 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:53.337033 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da] added
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:54:53.340160 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:53.340979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:54:53.340979 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:54:53.340979 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:54:53.346057 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:53.346790 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:53.346915 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:54:53.347217 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:54:53.401128 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Deleted allocations for instance 6a8fd917-0209-4446-b631-a83c282ef124
Jun 26 02:54:54.337337 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:54:54.341105 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:54.350677 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:54:54.357773 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.365601 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.374931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.387193 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.387562 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.393882 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.394055 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:54.410694 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-390b5bec-3994-4551-b65c-aad8611856b8 tempest-VolumesBackupsTest-1738581805 tempest-VolumesBackupsTest-1738581805-project-member] Lock "6a8fd917-0209-4446-b631-a83c282ef124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.326s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:54.434584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.50.100,3260]
Jun 26 02:54:54.434584 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.50.100,3260] successful.
Jun 26 02:54:54.434584 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.450679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.40.100,3260]
Jun 26 02:54:54.450679 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.40.100,3260] successful.
Jun 26 02:54:54.450679 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.451579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:54.463122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.471805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.482489 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.482743 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:54.483017 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:54.483179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:54.484409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] HCTL ('11', '-', '-', 0) found on session 176 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:54.484577 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.492726 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:54:54.493046 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:54:54.493403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:54.493403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:54:54.494354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] HCTL ('12', '-', '-', 0) found on session 177 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:54:54.494452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:54:54.503668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching for a device in session 176 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:54.503862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:54.512035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Searching for a device in session 177 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:54:54.512035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:54:55.031322 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005044249996899453 future=<Future at 0x72e29e7aa300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:55.031467 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:55.031625 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.900933228000213 future=<Future at 0x72e29c232cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:55.031741 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.900816640999892 future=<Future at 0x72e29c232cf0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:54:55.032327 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] Emitting event <LifecycleEvent: 1782442480.030697, 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:54:55.032617 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] VM Stopped (Lifecycle Event)
Jun 26 02:54:55.184349 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:55.303703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:54:55.343771 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:54:55.537617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-276d8639-2f86-4142-b905-ad58c49942e4 tempest-TestServerVolumeAttachmentScenario-1484440150 tempest-TestServerVolumeAttachmentScenario-1484440150-project-member] [instance: 2cf90e0d-a9c5-4dde-9bf9-4ba3c52a9294] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:54:55.849147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:55.849361 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:55.849566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:54:55.849766 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:54:56.321931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found WWN 330000000c3095f73 for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:54:56.322214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:54:56.322397 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000c3095f73', 'path': '/dev/dm-2', 'multipath_id': '330000000c3095f73'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:54:56.322538 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c3095f73', 'path': '/dev/dm-2', 'multipath_id': '330000000c3095f73'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:54:56.325152 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:54:56.827955 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Attempting to attach volume 28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:   <alias name="ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da"/>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:   <serial>28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da</serial>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:54:56.829162 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:54:56.878456 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:56.984249 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:56.984881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.084235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.091789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.189008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.189872 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.290850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.290850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:54:57.290850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:54:57.290850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-7 (vdd) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:54:57.300052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.359282 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:57.397994 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.398525 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.502801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.504995 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:54:57.512181 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:54:57.515534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.625315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.627670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.752715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.758469 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:54:57.760108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:54:57.813876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:54:57.814433 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=49938MB free_disk=71.83888626098633GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:54:57.814657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:54:57.814985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:54:58.490304 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:58.490733 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:58.490733 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:54:58.490733 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] No VIF found with MAC fa:16:3e:77:fb:01, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:54:58.530617 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:58.888240 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance fbed1f7d-1080-4781-aaca-03b672cb4168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:54:58.888360 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a5d387b7-a9ad-4a06-8504-93a902496c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:54:58.888460 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:54:58.888588 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:54:58.888928 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8e6a556d-6113-49db-93ab-8442ceba5275 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:54:58.889258 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:54:58.889392 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:54:57 up 41 min,  2 users,  load average: 6.34, 7.22, 5.26\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_0501274670f84685b7449e324b329eb8': '2', 'io_workload': '0', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '2', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:54:59.167909 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:54:59.168147 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:54:59.459615 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:54:59.670646 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:55:00.062809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b8c37331-9653-46a7-a536-5c019d9e352e tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.487s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:00.105645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:00.176274 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:55:00.176454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.361s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:00.176794 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:55:01.577692 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:02.360610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:03.028404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:03.028801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:03.172918 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:03.173994 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:03.173994 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:03.173994 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:03.174259 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.17 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:55:03.226276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:03.343924 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:03.344278 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:55:03.530757 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Detaching volume 28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da
Jun 26 02:55:03.564032 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Attempting to driver detach volume 28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da from mountpoint /dev/vdb
Jun 26 02:55:03.568385 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found disk vdb by alias ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:55:03.569325 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Found disk vdb by alias ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:55:03.569492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Attempting to detach device vdb from instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <alias name="ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da"/>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <serial>28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da</serial>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:03.569747 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:55:03.575200 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully detached device vdb from instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 from the persistent domain config.
Jun 26 02:55:03.575371 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] (1/8): Attempting to detach device vdb with device alias ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da from instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <alias name="ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da"/>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <serial>28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da</serial>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:03.575640 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:55:03.933081 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004397749999043299 future=<Future at 0x72e29c232cf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:03.933714 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Emitting event <LifecycleEvent: 1782442488.9324677, 6a8fd917-0209-4446-b631-a83c282ef124 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:03.933912 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:03.934085 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] VM Stopped (Lifecycle Event)
Jun 26 02:55:04.059523 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442504.059176, f44cbb04-f745-49d7-9f82-e7dcde2d68e6 => ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:55:04.060627 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da for instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:55:04.063643 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully detached device vdb from instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6 from the live domain config.
Jun 26 02:55:04.064745 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:55:04.065166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:04.065368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:04.065798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:04.066257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:55:04.066447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:55:04.094540 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da (non-flash)
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', '177')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:55:04.094840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', '177')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:55:04.095781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da', '176')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:55:04.096550 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4d2c00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'): ({'sdf'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:55:04.096729 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:55:04.096937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Flush multipath device 330000000c3095f73 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:55:04.127249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:55:04.179265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:55:04.223267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:55:04.223553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:55:04.224592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:55:04.235552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:55:04.235807 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:55:04.247632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.277665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.40.100,3260]
Jun 26 02:55:04.277665 np0000003683 nova-compute[98991]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.40.100,3260] successful.
Jun 26 02:55:04.277665 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.295593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.307919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.338756 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.50.100,3260]
Jun 26 02:55:04.338756 np0000003683 nova-compute[98991]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-28b2ab21-e8c4-4c9b-b91e-b47c5ffed0da, portal: 192.168.50.100,3260] successful.
Jun 26 02:55:04.338756 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.356022 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:04.356260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:04.356390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] <== disconnect_volume: return (290ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:55:04.356525 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:55:04.436646 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-46ba0c73-2767-465a-9608-4afb9c21d552 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: 6a8fd917-0209-4446-b631-a83c282ef124] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:04.460759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:04.587531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:04.587772 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:04.911209 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'flavor' on Instance uuid f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:05.089807 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:55:05.651783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:05.652083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:05.655730 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:55:05.655933 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Claim successful on node np0000003683
Jun 26 02:55:05.826708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:05.826902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:05.917804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d40a20ed-c451-436b-aad2-7389a8fe4797 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.889s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:06.052008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:06.052941 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing instance network info cache due to event network-changed-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:55:06.053368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] Acquiring lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:06.053368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] Acquired lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:06.054441 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Refreshing network info cache for port 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:55:06.330444 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:06.556115 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:06.599625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:06.599760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:06.599956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:06.600172 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:06.600219 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:06.602465 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Terminating instance
Jun 26 02:55:06.881662 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:06.996391 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:55:06.996640 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:55:07.048684 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updated VIF entry in instance network info cache for port 5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:55:07.049113 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating instance_info_cache with network_info: [{"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:07.105456 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:55:07.123845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.126419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.146786 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.279506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.287211 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.339305 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:07.362993 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.442604 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999720328999956 future=<Future at 0x72e29c208950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:07.442805 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99949561099993 future=<Future at 0x72e29c208950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:07.442915 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999387098999705 future=<Future at 0x72e29c208950 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:07.444959 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Instance destroyed successfully.
Jun 26 02:55:07.445435 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'resources' on Instance uuid f44cbb04-f745-49d7-9f82-e7dcde2d68e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:07.499159 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:55:07.551165 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3231402f-bf3e-414e-b634-d2f96eca1103 req-5c75553b-a8ba-4a2d-85d3-54d4b1637fad service nova] Releasing lock "refresh_cache-f44cbb04-f745-49d7-9f82-e7dcde2d68e6" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:07.947930 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-861717398',display_name='tempest-TestStampPattern-server-861717398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-861717398',id=65,image_ref='2afabee8-1ebb-45de-91b5-d295958af86b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:54:10Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-iv0fwt6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fbed1f7d-1080-4781-aaca-03b672cb4168',image_min_disk='1',image_min_ram='0',image_owner_id='0501274670f84685b7449e324b329eb8',image_owner_project_name='tempest-TestStampPattern-1659297009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1659297009-project-member',image_user_id='02816c16bbcd47f5a1d15ca6d6377e09',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:54:11Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=f44cbb04-f745-49d7-9f82-e7dcde2d68e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:55:07.948119 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "address": "fa:16:3e:77:fb:01", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa9aab8-17", "ovs_interfaceid": "5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:07.948702 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:07.948906 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:55:07.950206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.950515 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aa9aab8-17, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:07.951742 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.952903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.953611 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.953788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=886b9310-66e2-4a4e-b350-957f724eb8d5) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:07.954587 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:07.955225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:07.956889 np0000003683 nova-compute[98991]: INFO os_vif [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:fb:01,bridge_name='br-int',has_traffic_filtering=True,id=5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa9aab8-17')
Jun 26 02:55:07.957261 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Deleting instance files /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6_del
Jun 26 02:55:07.958121 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Deletion of /opt/stack/data/nova/instances/f44cbb04-f745-49d7-9f82-e7dcde2d68e6_del complete
Jun 26 02:55:08.005916 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.354s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:08.006283 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:55:08.105421 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:08.105629 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:08.105778 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:08.106126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:08.106247 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] No waiting events found dispatching network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:08.106357 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:08.106454 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:08.106586 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Acquiring lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:08.106731 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:08.106826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:08.106901 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] No waiting events found dispatching network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:08.106966 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-af8296f8-e661-43d7-89a8-d3e6c1a7079f req-a376504d-c5de-4ed9-9f8f-6d7257b98af4 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-unplugged-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:08.403978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:08.404260 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:08.404440 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Attaching volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b to /dev/vdb
Jun 26 02:55:08.446674 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:08.458969 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:55:08.464218 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:55:08.464949 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:55:08.465197 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:55:08.465316 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:55:08.465583 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:08.481590 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:08.516495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:55:08.517489 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:55:08.518213 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:08.518599 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:08.533904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:55:08.534436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:55:08.544180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:55:08.545407 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe6e:25dd', 'fe80::fc16:3eff:fe92:915c', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:55:08.545636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:55:08.545866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:55:08.546142 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:55:08.546414 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updating existing volume attachment record: 2853c1bc-4de3-4d54-b81a-779f19572bb2 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:55:08.595258 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c6f720766e94dd0ba2fab81ef66906f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b27156fe7ab4391b30a0b973577b79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:55:08.610084 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:08.992497 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Successfully created port: d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:55:09.024498 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:55:09.102819 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:55:09.103344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:09.103490 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:09.298701 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:09.465339 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Successfully updated port: d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:55:09.521735 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:09.521834 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing instance network info cache due to event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:55:09.522010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:09.522118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:09.522220 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:55:09.526450 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:55:09.800771 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Took 1.34 seconds to deallocate network for instance.
Jun 26 02:55:09.967632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:10.024050 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:10.081425 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:55:10.157378 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3f97c191-6eb2-435b-9176-788748752966 req-1d9377bc-be2d-4c6c-a7a8-e1c092ef64f5 service nova] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Received event network-vif-deleted-5aa9aab8-1737-4e6e-aa02-0a7cf6b17c8e {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:10.208192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:10.307012 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:10.307197 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:10.533966 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:55:10.534975 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:55:10.535601 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Creating image(s)
Jun 26 02:55:10.538802 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:10.538946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:10.539421 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:10.539683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:10.539972 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:10.589990 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:55:10.590250 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:55:10.709913 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-bdeb1bf3-1f6a-4bbf-8daf-f3755678521d req-b012cb3e-b802-425a-959d-4afb095c5685 service nova] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:10.710286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:10.710460 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:55:10.973670 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:10.976106 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:10.976608 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.082956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.083574 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] 3997ee2d-4074-4fef-8cbd-59663eca50b5 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:55:11.084273 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:55:11.084610 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.part /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.102445 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:55:11.274469 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:55:11.300010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.part /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.converted" returned: 0 in 0.215s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.305465 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.393526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.394078 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.854s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:11.394546 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:11.397316 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:11.398330 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.458494 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:11.465700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.358s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:11.465700 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:55:11.482077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:11.482995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:11.483580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:11.483780 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:55:11.484331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:11.484529 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:55:11.495131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.495630 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:11.496132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:11.496745 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:11.501590 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:55:11.503191 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.startup = automatic
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.scan = manual
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:55:11.505642 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:11.523243 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:11.524356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.545829 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.546611 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.547119 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:11.547725 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81fb2ca1-eead-4add-be45-5e2c72aaf1ec (non-flash)
Jun 26 02:55:11.548164 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:11.548466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:55:11.549014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:11.549190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:55:11.550299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('20', '0', '0', 0) found on session 170 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:55:11.550499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:55:11.550817 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('19', '0', '0', 0) found on session 169 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:55:11.550973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:55:11.560913 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 170 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:55:11.561046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:55:11.563546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 169 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:55:11.563661 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:55:11.599377 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:11.600985 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.601462 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c,backing_fmt=raw /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.619928 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.312s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:11.656743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c,backing_fmt=raw /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk 1073741824" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.657118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:11.657431 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.711592 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Deleted allocations for instance f44cbb04-f745-49d7-9f82-e7dcde2d68e6
Jun 26 02:55:11.748107 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.748560 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:55:11.748789 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:11.834977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:11.835369 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Cannot resize image /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:55:11.835807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:55:11.836012 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:55:11.836322 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:11.836605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:11.836757 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:12.102509 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:12.103016 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance network_info: |[{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:55:12.104873 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start _get_guest_xml network_info=[{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=3997ee2d-4074-4fef-8cbd-59663eca50b5,min_disk=0,min_ram=0,name='tempest-scenario-img--359998634',owner='7b27156fe7ab4391b30a0b973577b79c',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:55:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': '3997ee2d-4074-4fef-8cbd-59663eca50b5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:55:12.114758 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:55:12.116219 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3997ee2d-4074-4fef-8cbd-59663eca50b5', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-557685198', uuid='d46927ca-f4f7-4df7-8ec7-206ebbb96d5e'), owner=OwnerMeta(userid='5c6f720766e94dd0ba2fab81ef66906f', username='tempest-TestMinimumBasicScenario-325636508-project-member', projectid='7b27156fe7ab4391b30a0b973577b79c', projectname='tempest-TestMinimumBasicScenario-325636508'), image=ImageMeta(id='3997ee2d-4074-4fef-8cbd-59663eca50b5', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442512.1157804) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:55:12.117526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:55:12.117834 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:55:12.118714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:55:12.118910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:55:12.120114 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:55:12.120523 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=3997ee2d-4074-4fef-8cbd-59663eca50b5,min_disk=0,min_ram=0,name='tempest-scenario-img--359998634',owner='7b27156fe7ab4391b30a0b973577b79c',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:55:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:55:12.120726 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:55:12.120838 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:55:12.121034 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:55:12.121216 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:55:12.121273 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:55:12.121453 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:55:12.121601 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:55:12.121778 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:55:12.121880 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:55:12.122079 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:55:12.144766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:55:10Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:55:12.144962 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:12.146336 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:12.146649 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'pci_devices' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:12.365197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.485693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <uuid>d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</uuid>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <name>instance-00000044</name>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestMinimumBasicScenario-server-557685198</nova:name>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:55:12</nova:creationTime>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:image uuid="3997ee2d-4074-4fef-8cbd-59663eca50b5">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:user uuid="5c6f720766e94dd0ba2fab81ef66906f">tempest-TestMinimumBasicScenario-325636508-project-member</nova:user>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:project uuid="7b27156fe7ab4391b30a0b973577b79c">tempest-TestMinimumBasicScenario-325636508</nova:project>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="3997ee2d-4074-4fef-8cbd-59663eca50b5"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         <nova:port uuid="d8d5ef87-bf20-4565-8d3c-21933a1412ba">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="serial">d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="uuid">d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8f:f0:d3"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <target dev="tapd8d5ef87-bf"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/console.log" append="off"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:55:12.655984 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Preparing to wait for external event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:55:10Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:12.657899 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:12.658391 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:55:12.658391 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.658738 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:12.659264 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:55:12.660079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.660079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d71e78c-a78e-536c-85bd-161c245cf96b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:12.660890 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.661962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.664005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.664225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8d5ef87-bf, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:12.664615 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8d5ef87-bf, col_values=(('qos', UUID('fe9b8b00-3f14-4116-ad05-20957bc0284f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:12.664834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8d5ef87-bf, col_values=(('external_ids', {'iface-id': 'd8d5ef87-bf20-4565-8d3c-21933a1412ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:f0:d3', 'vm-uuid': 'd46927ca-f4f7-4df7-8ec7-206ebbb96d5e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:12.665619 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.666830 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:12.672576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:12.673465 np0000003683 nova-compute[98991]: INFO os_vif [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf')
Jun 26 02:55:12.724532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-338d8d9b-ede9-4b6b-a219-039b6ee6d09b tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "f44cbb04-f745-49d7-9f82-e7dcde2d68e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.125s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:13.506034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found WWN 330000000cbcd3290 for multipath device dm-7 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:55:13.506443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.045s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:13.506635 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== connect_volume: return (4402ms) {'type': 'block', 'scsi_wwn': '330000000cbcd3290', 'path': '/dev/dm-7', 'multipath_id': '330000000cbcd3290'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:55:13.506766 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cbcd3290', 'path': '/dev/dm-7', 'multipath_id': '330000000cbcd3290'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:55:13.509666 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:14.012543 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Attempting to attach volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:14.014077 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:55:14.188397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:14.188589 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:14.188758 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No VIF found with MAC fa:16:3e:8f:f0:d3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:55:14.189262 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Using config drive
Jun 26 02:55:14.694281 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:14.903930 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Creating config drive at /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config
Jun 26 02:55:14.908188 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjp50fo_2 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:14.966321 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjp50fo_2" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:15.351986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.373909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.437581 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.508623 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1640092c-b2b5-451d-8c65-c91ed24a3fc5 req-1f0803b1-eaaf-45dd-bc39-2b29eecc10c3 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:15.508891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1640092c-b2b5-451d-8c65-c91ed24a3fc5 req-1f0803b1-eaaf-45dd-bc39-2b29eecc10c3 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:15.509124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1640092c-b2b5-451d-8c65-c91ed24a3fc5 req-1f0803b1-eaaf-45dd-bc39-2b29eecc10c3 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:15.509287 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1640092c-b2b5-451d-8c65-c91ed24a3fc5 req-1f0803b1-eaaf-45dd-bc39-2b29eecc10c3 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:15.509865 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1640092c-b2b5-451d-8c65-c91ed24a3fc5 req-1f0803b1-eaaf-45dd-bc39-2b29eecc10c3 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Processing event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:55:15.646678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.648593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.650372 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.671739 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:15.681219 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:15.681433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:15.681433 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:15.681604 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:6e:25:dd, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:55:16.068252 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442516.0677884, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:16.068686 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:55:16.068831 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Started (Lifecycle Event)
Jun 26 02:55:16.071936 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:55:16.074633 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance spawned successfully.
Jun 26 02:55:16.075210 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:55:16.260834 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:16.261117 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing instance network info cache due to event network-changed-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:55:16.261337 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] Acquiring lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:16.261794 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] Acquired lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:16.261935 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Refreshing network info cache for port d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:55:16.571922 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:16.573878 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:55:16.580875 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.580999 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.581299 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.581524 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.581742 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.581959 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:55:16.723023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:16.723246 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:16.723456 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:16.723621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:16.723743 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:16.727335 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Terminating instance
Jun 26 02:55:16.765134 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:17.048428 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:17.075983 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:55:17.076271 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442517.0760312, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:17.076423 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Paused (Lifecycle Event)
Jun 26 02:55:17.086439 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Took 6.55 seconds to spawn the instance on the hypervisor.
Jun 26 02:55:17.086665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:17.211277 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updated VIF entry in instance network info cache for port d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:55:17.211614 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating instance_info_cache with network_info: [{"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:17.231244 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:55:17.238240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4624157a-8e57-4d51-b6d3-cbc93821a37d tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.834s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:17.251395 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.254144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.276843 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.278837 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.302668 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.367826 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.553717 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Instance destroyed successfully.
Jun 26 02:55:17.554090 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lazy-loading 'resources' on Instance uuid fbed1f7d-1080-4781-aaca-03b672cb4168 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:17.580344 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:17.580885 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:17.581087 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:17.581189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:17.581433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:17.581433 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received unexpected event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with vm_state active and task_state None.
Jun 26 02:55:17.581633 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:17.581633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:17.581755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:17.581845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:17.581956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] No waiting events found dispatching network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:17.582066 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:17.582160 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:17.582260 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Acquiring lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:17.582359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:17.582446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:17.582567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] No waiting events found dispatching network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:17.582662 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ffaae420-110f-4d54-9f9d-49b7ad52de70 req-912ee965-105e-49ec-bf90-fa132abc31ff service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-unplugged-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:17.583901 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:17.586146 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442517.585779, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:17.586305 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Resumed (Lifecycle Event)
Jun 26 02:55:17.601349 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Took 12.01 seconds to build instance.
Jun 26 02:55:17.666028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:17.713824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-53207062-7586-440a-97b2-e0bcb3acaca5 req-2f526303-4a28-4294-b232-e0a67a9e021f service nova] Releasing lock "refresh_cache-fbed1f7d-1080-4781-aaca-03b672cb4168" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:18.056220 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008281534',display_name='tempest-TestStampPattern-server-1008281534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-teststamppattern-server-1008281534',id=59,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAajywnc/ssdLRk6xYZG9KTIo6AVmj//7/CW1/6MtBTSGfaTDsKO6/jNvgrl2hw9Rcsl81dbomcwjo9eYikNFlagkTF8gy7eAs7Deg5i0IniuiVKpmUa05LGymoLmDEmcw==',key_name='tempest-TestStampPattern-902105697',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:51Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0501274670f84685b7449e324b329eb8',ramdisk_id='',reservation_id='r-ktozx8ao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1659297009',owner_user_name='tempest-TestStampPattern-1659297009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:53:56Z,user_data=None,user_id='02816c16bbcd47f5a1d15ca6d6377e09',uuid=fbed1f7d-1080-4781-aaca-03b672cb4168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:55:18.056388 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converting VIF {"id": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "address": "fa:16:3e:1b:47:8e", "network": {"id": "5fb6573b-3072-40d6-a1d2-e12d640ab700", "bridge": "br-int", "label": "tempest-TestStampPattern-1983553567-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0501274670f84685b7449e324b329eb8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3024e90-af", "ovs_interfaceid": "d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:18.056949 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:18.057183 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:55:18.058384 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:18.058691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3024e90-af, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:18.061031 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:18.062096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:18.062949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:18.063124 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8987ff97-e2a9-4aff-a637-8c76676de28c) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:18.063527 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:18.064128 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:18.064447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:18.068107 np0000003683 nova-compute[98991]: INFO os_vif [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:47:8e,bridge_name='br-int',has_traffic_filtering=True,id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0,network=Network(5fb6573b-3072-40d6-a1d2-e12d640ab700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3024e90-af')
Jun 26 02:55:18.068359 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Deleting instance files /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168_del
Jun 26 02:55:18.069002 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Deletion of /opt/stack/data/nova/instances/fbed1f7d-1080-4781-aaca-03b672cb4168_del complete
Jun 26 02:55:18.092537 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:18.099036 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:55:18.102541 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.515s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:18.580574 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 26 02:55:18.581277 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:55:18.581686 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:55:18.581809 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:55:18.582075 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:18.603549 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999739945999863 future=<Future at 0x72e27c4e62a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:18.655072 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:19.001076 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5a86f1cb-4226-4573-b144-a389c9928d1d req-623c324e-2460-4006-9f3a-ee83ada49716 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Received event network-vif-deleted-d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:19.001670 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-5a86f1cb-4226-4573-b144-a389c9928d1d req-623c324e-2460-4006-9f3a-ee83ada49716 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Neutron deleted interface d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0; detaching it from the instance and deleting it from the info cache
Jun 26 02:55:19.003318 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5a86f1cb-4226-4573-b144-a389c9928d1d req-623c324e-2460-4006-9f3a-ee83ada49716 service nova] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Detach interface failed, port_id=d3024e90-af0b-4de2-aa2d-4f0c2eff0ad0, reason: Instance fbed1f7d-1080-4781-aaca-03b672cb4168 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:55:19.442502 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:19.825314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:19.825792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:19.944126 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Took 1.36 seconds to deallocate network for instance.
Jun 26 02:55:20.116296 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:20.116543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:20.327733 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Detaching volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:55:20.367272 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Attempting to driver detach volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b from mountpoint /dev/vdb
Jun 26 02:55:20.370972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:55:20.371912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:55:20.372028 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attempting to detach device vdb from instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:20.372239 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:55:20.377090 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 from the persistent domain config.
Jun 26 02:55:20.377215 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] (1/8): Attempting to detach device vdb with device alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b from instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:20.377422 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:55:20.449423 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:20.449644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:20.619601 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:20.713135 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:55:20.713331 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:55:20.917280 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442520.916956, 6cc2f43d-80ff-4086-ab53-a7b0458715e6 => ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:55:20.920128 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b for instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:55:20.921035 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 from the live domain config.
Jun 26 02:55:21.216156 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:55:21.461490 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Detected multiple connections on this host for volume: aa1a627c-23d9-4058-a9bf-7f68c54bff1b, skipping target disconnect.
Jun 26 02:55:21.625576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:21.724927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.275s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:21.770117 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Deleted allocations for instance fbed1f7d-1080-4781-aaca-03b672cb4168
Jun 26 02:55:22.013455 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:22.368631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:22.442775 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004370470001049398 future=<Future at 0x72e29c208950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:22.442878 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:22.442999 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.160203470999932 future=<Future at 0x72e27c4e62a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:22.443617 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442507.4422312, f44cbb04-f745-49d7-9f82-e7dcde2d68e6 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:22.443802 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.159403210999699 future=<Future at 0x72e27c4e62a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:22.443956 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] VM Stopped (Lifecycle Event)
Jun 26 02:55:22.725728 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:22.725904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:22.726077 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attaching volume 3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 to /dev/vdb
Jun 26 02:55:22.767637 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:22.778939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c790f24d-86fe-4ed6-a3d2-c27a7e038927 tempest-TestStampPattern-1659297009 tempest-TestStampPattern-1659297009-project-member] Lock "fbed1f7d-1080-4781-aaca-03b672cb4168" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.056s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:22.780299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:55:22.800461 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:22.855371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:55:22.857234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:55:22.865354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:55:22.866537 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe6e:25dd', 'fe80::fc16:3eff:fe92:915c', 'fe80::d4b5:11ff:fee7:5f60', 'fe80::fc16:3eff:fe8f:f0d3', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:55:22.867211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:55:22.867349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:55:22.867600 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:55:22.867846 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating existing volume attachment record: 0b0ad3d8-d62a-4b06-b57c-1cb1333d608e {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:55:22.947148 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: f44cbb04-f745-49d7-9f82-e7dcde2d68e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:23.021697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5ccf4d39-5c4d-486c-a294-7431766a37ae tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.196s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:23.041190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:23.041388 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:23.041649 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:23.041809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:23.041949 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:23.044041 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Terminating instance
Jun 26 02:55:23.064123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.428373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:55:23.428755 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:23.428891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:23.547189 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:55:23.564728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.567429 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.591508 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.723836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:23.724798 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:23.724978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:23.725220 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.725391 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:23.725580 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] No waiting events found dispatching network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:23.726141 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-108e1240-c611-43cd-8296-3467c504f8c8 req-e93c4c0d-a210-4336-a4a0-3cfee039a684 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:23.730181 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.844848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.854638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:23.880573 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99970556199969 future=<Future at 0x72e29c2474d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:23.882988 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Instance destroyed successfully.
Jun 26 02:55:23.883670 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'resources' on Instance uuid 6cc2f43d-80ff-4086-ab53-a7b0458715e6 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:23.981915 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.553s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:23.982239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:55:23.996877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:23.998888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:23.998888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:23.998888 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:55:23.998888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:24.000468 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:55:24.010565 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:55:24.010565 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:24.015570 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:55:24.015570 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363] added
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:55:24.026279 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:24.026896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:55:24.026896 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:55:24.026896 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363] added
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:55:24.031606 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:24.031898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:55:24.032001 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:55:24.032229 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:55:24.388218 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-673388553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-673388553',id=66,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:54:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-n9k8038x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=6cc2f43d-80ff-4086-ab53-a7b0458715e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:55:24.390519 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "ed2547b7-d704-482a-9dfb-dfade87dc165", "address": "fa:16:3e:6e:25:dd", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped2547b7-d7", "ovs_interfaceid": "ed2547b7-d704-482a-9dfb-dfade87dc165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:24.390519 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:24.390519 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:55:24.390821 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:24.390821 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped2547b7-d7, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:24.391953 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:24.392728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:24.393005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:24.393713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:24.393868 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d101a4b1-23b4-408a-89e6-822dcdded88b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:24.394259 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:24.394795 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:24.396917 np0000003683 nova-compute[98991]: INFO os_vif [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed2547b7-d704-482a-9dfb-dfade87dc165,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped2547b7-d7')
Jun 26 02:55:24.427929 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:55:24.427929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:24.427929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:25.027507 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:55:25.032680 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:55:25.041760 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:55:25.048646 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.058496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.063641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.077885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.084777 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.085283 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:25.135504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260]
Jun 26 02:55:25.135504 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260] successful.
Jun 26 02:55:25.135504 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.149891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.158797 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260]
Jun 26 02:55:25.158797 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260] successful.
Jun 26 02:55:25.158797 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:25.170043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:55:25.170728 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:55:25.171932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('13', '-', '-', 0) found on session 184 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:55:25.172260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:25.191413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:55:25.192302 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('14', '-', '-', 0) found on session 185 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:55:25.194995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:55:25.194995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 184 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:55:25.194995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:55:25.212357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 185 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:55:25.212542 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:55:25.804740 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:25.805720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] Acquiring lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:25.805720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:25.805720 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:25.805720 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] No waiting events found dispatching network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:25.805720 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-da2e319f-15c4-49d5-8ba7-f86219f89506 req-a63a1154-d219-49b2-a11b-77fadccc9cac service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-unplugged-ed2547b7-d704-482a-9dfb-dfade87dc165 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:55:25.998848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:55:26.617559 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:27.013863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found WWN 330000000e4736b49 for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:55:27.014165 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:55:27.014328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== connect_volume: return (3585ms) {'type': 'block', 'scsi_wwn': '330000000e4736b49', 'path': '/dev/dm-3', 'multipath_id': '330000000e4736b49'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:55:27.014466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4736b49', 'path': '/dev/dm-3', 'multipath_id': '330000000e4736b49'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:55:27.015088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.587s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:55:27.015602 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:55:27.015933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:55:27.020491 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:27.046541 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:55:27.046895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '185')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:55:27.047251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:55:27.048539 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:55:27.049875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a1580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'): ({'sdn'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:55:27.050161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Removing multipathed devices sdn, sdo {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:55:27.050426 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flush multipath device 330000000cbcd3290 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:55:27.103016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:27.103274 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:27.103447 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:27.105824 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98991) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 26 02:55:27.106268 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'flavor' on Instance uuid 8e6a556d-6113-49db-93ab-8442ceba5275 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:27.370751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:27.523666 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attempting to attach volume 3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:   <alias name="ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363"/>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-3"/>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:   <serial>3fd9685d-5bc2-4eb3-9b3c-49bfede5b363</serial>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:55:27.525343 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:55:28.140970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.143380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.161147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.165641 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.185741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.190529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.348728 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:28.348898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:28.349065 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:28.349175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:28.349282 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] No waiting events found dispatching network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:28.349393 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-83803499-630d-4547-985a-512fda8b9169 req-581a5f25-1dea-4b47-b10d-0dfbeedb4a86 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received unexpected event network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d for instance with vm_state active and task_state powering-off.
Jun 26 02:55:28.412112 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.420250 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.425749 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:28.443998 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999731760000031 future=<Future at 0x72e29c65eea0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:28.446507 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance destroyed successfully.
Jun 26 02:55:28.446866 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e6a556d-6113-49db-93ab-8442ceba5275 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:28.948732 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<8e6a556d-6113-49db-93ab-8442ceba5275> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:55:28.948979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:29.184027 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:29.184027 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:29.184027 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:55:29.184027 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No VIF found with MAC fa:16:3e:8f:f0:d3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:55:29.398061 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:29.456008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ba16d462-5a79-45d1-9704-8880da733ae4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.353s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:30.421853 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:30.422656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:30.422656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:30.422656 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:30.422886 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] No waiting events found dispatching network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:30.422886 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7e227e67-f3ad-436b-b1bd-11fb5d4ff340 req-741f2956-d92d-4435-a3c5-02d22ee3aaa7 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received unexpected event network-vif-unplugged-00da51f4-e338-413a-a5ee-efd2fe10754d for instance with vm_state stopped and task_state None.
Jun 26 02:55:30.743016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e1c05909-bb9c-4ec0-a17b-6feb10c1f335 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.017s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:33.151771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:33.152199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:33.152199 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:33.152357 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:33.152530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:33.154777 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Terminating instance
Jun 26 02:55:33.603661 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00041311100039820303 future=<Future at 0x72e27c4e62a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:33.603949 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:33.604288 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Emitting event <LifecycleEvent: 1782442518.6031206, fbed1f7d-1080-4781-aaca-03b672cb4168 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:33.604489 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.2756873629996335 future=<Future at 0x72e29c2474d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:33.604715 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] VM Stopped (Lifecycle Event)
Jun 26 02:55:33.605759 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.274419633999969 future=<Future at 0x72e29c2474d0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:33.659529 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:55:33.666004 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Instance destroyed successfully.
Jun 26 02:55:33.666520 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 8e6a556d-6113-49db-93ab-8442ceba5275 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:33.701752 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:33.702102 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing instance network info cache due to event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:55:33.702272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:33.702345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:33.702474 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:55:34.107542 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-1a342f31-d148-4386-ad7a-1014fde8c5c7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: fbed1f7d-1080-4781-aaca-03b672cb4168] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:34.168692 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2080187697',display_name='tempest-TestVolumeBootPattern-server-2080187697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-2080187697',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmaifaYHeXEZyr88EUZDGvp0f4wjPNTGZETWPM2LBKnj7TX121SxnNOFGDpvdaobUG8L8sUI7IR8Sk+uQ1YyIKSSwENgizLN+ZBoXr7Eul7xYyqA+oC4AIQxzQ6Sr7WCA==',key_name='tempest-keypair-1925457615',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:54:45Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-j2l606jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=8e6a556d-6113-49db-93ab-8442ceba5275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:55:34.169141 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "00da51f4-e338-413a-a5ee-efd2fe10754d", "address": "fa:16:3e:92:91:5c", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00da51f4-e3", "ovs_interfaceid": "00da51f4-e338-413a-a5ee-efd2fe10754d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:34.169346 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:34.169575 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:55:34.170319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.170484 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00da51f4-e3, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:34.171252 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.171973 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:34.172465 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.173237 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.173392 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89827df4-b53f-4580-812d-d2afaf2c6f80) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:34.173855 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.174419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:34.174593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:34.176785 np0000003683 nova-compute[98991]: INFO os_vif [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:91:5c,bridge_name='br-int',has_traffic_filtering=True,id=00da51f4-e338-413a-a5ee-efd2fe10754d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00da51f4-e3')
Jun 26 02:55:34.178300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:55:34.178623 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:34.178769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:34.205117 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:34.575684 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:34.696170 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updated VIF entry in instance network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:55:34.696421 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:35.181380 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:35.181907 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing instance network info cache due to event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:55:35.181907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:35.198508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b4e1021d-6c03-4fc5-bdb1-53b47a839a72 req-c2700a7c-00aa-403f-8b97-5340c3c79513 service nova] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:35.198989 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:35.199207 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:55:35.701344 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:35.986324 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:36.114740 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updated VIF entry in instance network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:55:36.115020 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:36.617063 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6066c7c9-a54a-4650-be40-66efad7280cd req-58d2a680-800f-449f-9c8e-ef97ad31b503 service nova] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:37.372715 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:38.880664 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004117739999855985 future=<Future at 0x72e29c2474d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:38.881250 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442523.8801057, 6cc2f43d-80ff-4086-ab53-a7b0458715e6 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:38.881425 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:38.881693 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] VM Stopped (Lifecycle Event)
Jun 26 02:55:38.881862 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.561847327000123 future=<Future at 0x72e29c65eea0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:38.882911 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=4.560817150000275 future=<Future at 0x72e29c65eea0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:39.174785 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:39.384316 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:39.385942 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:55:39.889188 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 26 02:55:42.374237 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:43.444150 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003421649998927023 future=<Future at 0x72e29c65eea0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:43.444714 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] Emitting event <LifecycleEvent: 1782442528.4436162, 8e6a556d-6113-49db-93ab-8442ceba5275 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:55:43.444976 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:43.445170 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] VM Stopped (Lifecycle Event)
Jun 26 02:55:43.947787 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:43.951180 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: deleting, current DB power_state: 4, VM power_state: 4 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:55:44.175601 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:44.452408 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a827251a-c276-41b1-bf53-947f5c0029a2 tempest-TestShelveInstance-816092709 tempest-TestShelveInstance-816092709-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 26 02:55:46.006241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:46.006693 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:46.006693 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Rebooting instance
Jun 26 02:55:46.557146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:55:46.557146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:55:46.557146 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:55:47.058686 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:47.347549 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:55:47.376226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:47.465079 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:55:47.966895 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:55:48.470461 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:55:49.177091 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.500530 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.502589 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.517206 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.521894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.538809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.543691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:49.634233 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:49.634325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:49.634564 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:49.634654 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:49.634783 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:49.635582 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-553eef2a-5fe8-4812-b093-6cb65a28fa64 req-e63d08ad-c4d1-49db-9371-7f864f46e1f4 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received unexpected event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with vm_state active and task_state reboot_started_hard.
Jun 26 02:55:49.808550 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99965087999999 future=<Future at 0x72e29c3d1190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:49.809049 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999139326999739 future=<Future at 0x72e29c3d1190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:49.809215 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998921651999808 future=<Future at 0x72e29c3d1190 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:55:49.810795 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance destroyed successfully.
Jun 26 02:55:49.811365 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'resources' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:55:50.313627 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:55:17Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:55:48Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:55:50.313858 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:55:50.314294 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:55:50.314495 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:55:50.315315 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.315492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8d5ef87-bf, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:50.316334 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.317099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:50.317337 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.317924 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.318099 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe9b8b00-3f14-4116-ad05-20957bc0284f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:55:50.318491 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.318899 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:55:50.319144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:50.320656 np0000003683 nova-compute[98991]: INFO os_vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf')
Jun 26 02:55:50.322244 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:55:50.322488 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:55:50.322620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:55:51.690814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:55:51.691335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:51.691876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:51.691876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:51.691876 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:55:51.692029 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3d51baf3-b6c5-4825-a37e-870110978a58 req-e0fcdaee-0991-427f-a4f1-953be4169416 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received unexpected event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with vm_state active and task_state reboot_started_hard.
Jun 26 02:55:52.377225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:53.343765 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:53.344301 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:55:53.344301 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:55:54.344120 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:54.344600 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:55:55.318943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:55:55.343815 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:55:55.850832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:55.851310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:55.851310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:55.851428 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:55:56.873379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:56.965732 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:56.966331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.057930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.058454 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:55:57.058598 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:55:57.058707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-7 (vdd) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:55:57.063133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:55:57.064843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.157689 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.158143 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.247371 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.247912 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:55:57.252497 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.345726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.346238 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.438616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.442690 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:55:57.444130 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:55:57.499171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:55:57.499590 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51477MB free_disk=71.81171417236328GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:55:57.499753 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:55:57.500003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:55:58.554338 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a5d387b7-a9ad-4a06-8504-93a902496c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:55:58.554699 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:55:58.554699 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 8e6a556d-6113-49db-93ab-8442ceba5275 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:55:58.554699 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:55:58.554853 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:55:58.554947 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:55:57 up 42 min,  2 users,  load average: 3.70, 6.34, 5.09\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '1', 'num_os_type_None': '4', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '2', 'io_workload': '0', 'num_task_deleting': '2', 'num_vm_stopped': '1', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'num_task_reboot_started_hard': '1', 'num_proj_7b27156fe7ab4391b30a0b973577b79c': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:55:58.754631 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:55:58.754869 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:55:59.257807 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:55:59.763812 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:55:59.764248 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.264s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:55:59.764303 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:00.320890 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:02.764582 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:02.764978 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:02.764978 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:02.765130 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:02.765379 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.58 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:03.343868 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:03.344138 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:04.340256 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:04.340785 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:04.808857 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004831880000892852 future=<Future at 0x72e29c3d1190 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:56:04.810150 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] Emitting event <LifecycleEvent: 1782442549.8080647, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:04.810150 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Stopped (Lifecycle Event)
Jun 26 02:56:04.811024 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:56:05.312709 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:05.314765 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 4 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:56:05.322678 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:05.816934 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bb69480-ae9e-43d3-97a6-877d66d9efc5 tempest-TestVolumeBootPatternV346-766983106 tempest-TestVolumeBootPatternV346-766983106-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jun 26 02:56:07.736952 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:10.328114 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:10.328602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:10.328602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 02:56:10.328602 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:10.337442 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:10.337616 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:15.342809 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:15.343123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:15.343123 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 02:56:15.343176 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:15.344521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:15.344684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:20.350564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:20.350564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:20.350564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 02:56:20.350564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:20.351235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 02:56:20.351235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:25.352988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:27.079695 np0000003683 nova-compute[98991]: WARNING os_brick.exception [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flushing 330000000cbcd3290 failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:56:27.080179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.121869 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.166984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:56:27.167232 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:56:27.169166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:56:27.180613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:56:27.181001 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:27.192916 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.237774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.40.100,3260]
Jun 26 02:56:27.237774 np0000003683 nova-compute[98991]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:27.237774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.262771 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.277137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.320061 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.50.100,3260]
Jun 26 02:56:27.320061 np0000003683 nova-compute[98991]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:27.320061 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.340716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.340879 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Removing multipath device map 330000000cbcd3290 to stop multipathd from monitoring the device. {{(pid=98991) _cleanup_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1009}}
Jun 26 02:56:27.341204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Multipath 330000000cbcd3290 no longer present {{(pid=98991) multipath_del_map /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:894}}
Jun 26 02:56:27.341301 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] There were errors removing {'sdn', 'sdo'}, leftovers may remain in the system
Jun 26 02:56:27.341561 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.327s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== disconnect_volume: exception (62914ms)
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]: Chained Exception #1
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         Traceback (most recent call last):
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             self.flush_multipath_device(multipath_name)
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             result = self.__execute(*args, **kwargs)
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             return execute_root(*cmd, **kwargs)
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:             raise exc_type(*result[2])
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         Command: multipath -f 330000000cbcd3290
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         Exit code: 1
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         Stdout: ''
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:         Stderr: '2525.853254 | 330000000cbcd3290: map in use\n'
Jun 26 02:56:27.343594 np0000003683 nova-compute[98991]:          {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:188}}
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Ignoring Volume Error on vol aa1a627c-23d9-4058-a9bf-7f68c54bff1b during delete
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]: Chained Exception #1
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         Traceback (most recent call last):
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             self.flush_multipath_device(multipath_name)
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             result = self.__execute(*args, **kwargs)
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             return execute_root(*cmd, **kwargs)
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:             raise exc_type(*result[2])
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         Command: multipath -f 330000000cbcd3290
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         Exit code: 1
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         Stdout: ''
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         Stderr: '2525.853254 | 330000000cbcd3290: map in use\n'
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]:         : os_brick.exception.ExceptionChainer:
Jun 26 02:56:27.344416 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Deleting instance files /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6_del
Jun 26 02:56:27.345077 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 53.166s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:27.345427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6139f634-bf14-4896-b77a-8295e043bacc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:56:27.345690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:56:27.346413 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Deletion of /opt/stack/data/nova/instances/6cc2f43d-80ff-4086-ab53-a7b0458715e6_del complete
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.379703 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:27.380145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '185')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:56:27.380569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:27.381706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:27.383200 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7b7380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'): ({'sdj'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:56:27.384151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdl, sdj {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:56:27.384151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 33000000014e72ab8 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:56:27.442238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.489009 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.535760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdl, sdj have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:56:27.535967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdl, sdj have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:56:27.537067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdl', 'sdj'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:56:27.547365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdl', 'sdj'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:56:27.547548 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:27.558933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.591406 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.40.100,3260]
Jun 26 02:56:27.591406 np0000003683 nova-compute[98991]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:27.591406 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.609427 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.620074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.654858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.50.100,3260]
Jun 26 02:56:27.654858 np0000003683 nova-compute[98991]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:27.654858 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.671892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.672151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:27.672310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (53493ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:27.672488 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:56:27.672893 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Deleting instance files /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275_del
Jun 26 02:56:27.673254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 37.351s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:27.673612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:56:27.673763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:56:27.674410 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Deletion of /opt/stack/data/nova/instances/8e6a556d-6113-49db-93ab-8442ceba5275_del complete
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.701347 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:27.701691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '185')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:56:27.702514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '184')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:27.702770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '185')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:27.703506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7b7380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:56:27.703679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:56:27.703931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flush multipath device 330000000e4736b49 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:56:27.740044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.780916 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:27.830999 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:56:27.831245 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:56:27.832410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:56:27.843447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:56:27.843674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:27.855088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.857010 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Took 64.31 seconds to destroy the instance on the hypervisor.
Jun 26 02:56:27.857759 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:56:27.857964 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:56:27.858102 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:56:27.858404 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:27.896611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260]
Jun 26 02:56:27.896611 np0000003683 nova-compute[98991]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:27.896611 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.913458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.925340 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.959877 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:27.966541 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260]
Jun 26 02:56:27.966541 np0000003683 nova-compute[98991]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:27.966541 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.982347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:27.982599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:27.982710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== disconnect_volume: return (37660ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:27.982850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:56:27.988060 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start _get_guest_xml network_info=[{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3997ee2d-4074-4fef-8cbd-59663eca50b5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': '3997ee2d-4074-4fef-8cbd-59663eca50b5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b0ad3d8-d62a-4b06-b57c-1cb1333d608e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'd46927ca-f4f7-4df7-8ec7-206ebbb96d5e', 'attached_at': '', 'detached_at': '', 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'serial': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:56:27.990465 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:56:27.992093 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3997ee2d-4074-4fef-8cbd-59663eca50b5', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-557685198', uuid='d46927ca-f4f7-4df7-8ec7-206ebbb96d5e'), owner=OwnerMeta(userid='5c6f720766e94dd0ba2fab81ef66906f', username='tempest-TestMinimumBasicScenario-325636508-project-member', projectid='7b27156fe7ab4391b30a0b973577b79c', projectname='tempest-TestMinimumBasicScenario-325636508'), image=ImageMeta(id='3997ee2d-4074-4fef-8cbd-59663eca50b5', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442587.9916291) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:56:27.993394 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:56:27.993942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:56:27.995104 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:56:27.995344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:56:27.996508 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:56:27.996892 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3997ee2d-4074-4fef-8cbd-59663eca50b5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:56:27.997096 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:56:27.997214 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:56:27.997382 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:56:27.997531 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:56:27.997673 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:56:27.997896 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:56:27.998067 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:56:27.998228 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:56:27.998380 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:56:27.998571 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:56:27.998781 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'vcpu_model' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:28.182966 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Took 54.52 seconds to destroy the instance on the hypervisor.
Jun 26 02:56:28.183722 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:56:28.183993 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:56:28.184135 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:56:28.184412 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:28.241417 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:28.282728 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:28.355050 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3465f270-7b96-4276-928b-2ee9e5e99a52 req-94b68a63-347c-4856-b1e1-01216576c728 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Received event network-vif-deleted-ed2547b7-d704-482a-9dfb-dfade87dc165 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:28.355213 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-3465f270-7b96-4276-928b-2ee9e5e99a52 req-94b68a63-347c-4856-b1e1-01216576c728 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Neutron deleted interface ed2547b7-d704-482a-9dfb-dfade87dc165; detaching it from the instance and deleting it from the info cache
Jun 26 02:56:28.357225 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3465f270-7b96-4276-928b-2ee9e5e99a52 req-94b68a63-347c-4856-b1e1-01216576c728 service nova] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Detach interface failed, port_id=ed2547b7-d704-482a-9dfb-dfade87dc165, reason: Instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:56:28.503119 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Object Instance<d46927ca-f4f7-4df7-8ec7-206ebbb96d5e> lazy-loaded attributes: resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:56:28.520683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:28.613038 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:28.613556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:28.613816 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:28.614444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:28.614956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:56:28.615285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:28.615441 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:28.720671 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c08b4f73-1e76-4931-a0e3-fb799d684da5 req-1d6cfead-1f84-4ffe-86c6-d45f4ba38d12 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Received event network-vif-deleted-00da51f4-e338-413a-a5ee-efd2fe10754d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:28.720744 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-c08b4f73-1e76-4931-a0e3-fb799d684da5 req-1d6cfead-1f84-4ffe-86c6-d45f4ba38d12 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Neutron deleted interface 00da51f4-e338-413a-a5ee-efd2fe10754d; detaching it from the instance and deleting it from the info cache
Jun 26 02:56:28.723717 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c08b4f73-1e76-4931-a0e3-fb799d684da5 req-1d6cfead-1f84-4ffe-86c6-d45f4ba38d12 service nova] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Detach interface failed, port_id=00da51f4-e338-413a-a5ee-efd2fe10754d, reason: Instance 8e6a556d-6113-49db-93ab-8442ceba5275 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:56:28.814190 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:29.148149 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:29.317072 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Took 1.46 seconds to deallocate network for instance.
Jun 26 02:56:29.335418 np0000003683 nova-compute[98991]: WARNING nova.volume.cinder [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attachment 2853c1bc-4de3-4d54-b81a-779f19572bb2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2853c1bc-4de3-4d54-b81a-779f19572bb2. (HTTP 404) (Request-ID: req-d075a2d3-c263-42c5-b243-006bf2573213)
Jun 26 02:56:29.335792 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 6cc2f43d-80ff-4086-ab53-a7b0458715e6] Took 0.02 seconds to detach 1 volumes for instance.
Jun 26 02:56:29.651665 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Took 1.47 seconds to deallocate network for instance.
Jun 26 02:56:29.841622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:29.841622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:30.064690 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:30.064924 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:30.204115 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 8e6a556d-6113-49db-93ab-8442ceba5275] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:56:30.354246 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:30.567491 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:30.572248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.957s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:30.572763 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:56:30.585768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:30.586235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:30.587904 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:56:30.590055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:30.590493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:30.590493 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:56:30.602835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:56:30.602835 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:30.609193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:56:30.609193 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363] added
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:30.616301 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:30.616558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:56:30.616720 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:56:30.616891 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363] added
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:30.622415 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:30.622702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:56:30.622772 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:56:30.622877 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:56:30.709299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:31.075074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:31.076847 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.366s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:31.162189 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Deleted allocations for instance 6cc2f43d-80ff-4086-ab53-a7b0458715e6
Jun 26 02:56:31.365369 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:31.365886 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:31.617433 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:56:31.623265 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:56:31.630147 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:56:31.637953 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.642938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.649987 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.662691 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.662866 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.671581 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.671777 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:31.706988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260]
Jun 26 02:56:31.706988 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:31.706988 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.718748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.726625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260]
Jun 26 02:56:31.726625 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:31.726625 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.734075 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.734308 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:31.734650 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:31.734806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:56:31.735888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('11', '-', '-', 0) found on session 187 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:56:31.736057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:56:31.740708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:31.751691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 187 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:56:31.751691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:31.758979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:56:31.759532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('12', '-', '-', 0) found on session 188 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:56:31.759532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:56:31.773109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 188 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:56:31.773109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:56:31.868495 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:32.170618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0d8f86a5-0a04-4e80-871c-54e68f431bd2 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "6cc2f43d-80ff-4086-ab53-a7b0458715e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 69.129s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:32.377859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.303s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:32.426294 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 8e6a556d-6113-49db-93ab-8442ceba5275
Jun 26 02:56:32.542583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:32.542637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:32.590938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:56:33.045394 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Detaching volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b
Jun 26 02:56:33.088119 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to driver detach volume aa1a627c-23d9-4058-a9bf-7f68c54bff1b from mountpoint /dev/vdd
Jun 26 02:56:33.093336 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdd by alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:33.094788 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdd by alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:33.094956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attempting to detach device vdd from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <target dev="vdd" bus="virtio"/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:33.095322 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:33.101590 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdd from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config.
Jun 26 02:56:33.101715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] (1/8): Attempting to detach device vdd with device alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <alias name="ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b"/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-7"/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <target dev="vdd" bus="virtio"/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <serial>aa1a627c-23d9-4058-a9bf-7f68c54bff1b</serial>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:33.101949 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:33.435739 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ad0a256-0745-4b8b-a3e9-b145f72ea055 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "8e6a556d-6113-49db-93ab-8442ceba5275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 60.284s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:33.612585 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442593.6121438, a5d387b7-a9ad-4a06-8504-93a902496c23 => ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:56:33.614142 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-aa1a627c-23d9-4058-a9bf-7f68c54bff1b for instance a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:56:33.617675 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdd from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config.
Jun 26 02:56:33.621628 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found WWN 330000000e4736b49 for multipath device dm-2 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:56:33.622059 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:33.622299 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== connect_volume: return (5006ms) {'type': 'block', 'scsi_wwn': '330000000e4736b49', 'path': '/dev/dm-2', 'multipath_id': '330000000e4736b49'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:33.622446 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e4736b49', 'path': '/dev/dm-2', 'multipath_id': '330000000e4736b49'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:56:33.651087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:56:33.651419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:33.651600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:33.651946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:33.652342 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:56:33.652492 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:33.679841 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:33.680072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:56:33.680256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:33.680256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:56:33.680533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b, 0): [] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:33.680533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b') {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 26 02:56:33.680533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3e4360>, {}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:56:33.680690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Disconnecting from: [] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:33.680803 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:33.680891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== disconnect_volume: return (29ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:33.680995 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:56:34.128886 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:55:17Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:55:48Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:56:34.129160 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:34.129898 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:34.130919 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'pci_devices' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:34.239086 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:34.632795 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Object Instance<d46927ca-f4f7-4df7-8ec7-206ebbb96d5e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <uuid>d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</uuid>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <name>instance-00000044</name>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestMinimumBasicScenario-server-557685198</nova:name>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:56:27</nova:creationTime>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:image uuid="3997ee2d-4074-4fef-8cbd-59663eca50b5">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:user uuid="5c6f720766e94dd0ba2fab81ef66906f">tempest-TestMinimumBasicScenario-325636508-project-member</nova:user>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:project uuid="7b27156fe7ab4391b30a0b973577b79c">tempest-TestMinimumBasicScenario-325636508</nova:project>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="3997ee2d-4074-4fef-8cbd-59663eca50b5"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         <nova:port uuid="d8d5ef87-bf20-4565-8d3c-21933a1412ba">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="serial">d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="uuid">d46927ca-f4f7-4df7-8ec7-206ebbb96d5e</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk.config"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <alias name="ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-2"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <target dev="vdb" bus="virtio"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <serial>3fd9685d-5bc2-4eb3-9b3c-49bfede5b363</serial>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8f:f0:d3"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <target dev="tapd8d5ef87-bf"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/console.log" append="off"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:56:34.634223 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:56:34.637703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:34.740136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:34.740678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:34.832578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:34.833176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:56:34.833925 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'trusted_certs' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:35.261059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6c00ef7-5d05-4e40-8fb9-5e5567226229 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.718s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:35.336563 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Object Instance<d46927ca-f4f7-4df7-8ec7-206ebbb96d5e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:56:35.337567 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:35.356579 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:35.430048 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc60c99efd0dae12e78cb9fe73fd83d2521f7c3c --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:35.430606 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:56:35.430882 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:35.515009 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:35.515441 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Cannot resize image /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:56:35.515762 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'migration_context' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:35.838752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:35.839306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:36.018863 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Object Instance<d46927ca-f4f7-4df7-8ec7-206ebbb96d5e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:56:36.023831 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:55:17Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:55:48Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:56:36.024105 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:36.029614 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:36.029959 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:56:36.031351 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.031880 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:36.032251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:56:36.033209 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.033417 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d71e78c-a78e-536c-85bd-161c245cf96b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:36.035050 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.035747 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:36.036231 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.039490 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.039673 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8d5ef87-bf, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:36.040141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8d5ef87-bf, col_values=(('qos', UUID('4e2dddd1-afbf-437a-911a-af8d1a203d21')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:36.040415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8d5ef87-bf, col_values=(('external_ids', {'iface-id': 'd8d5ef87-bf20-4565-8d3c-21933a1412ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:f0:d3', 'vm-uuid': 'd46927ca-f4f7-4df7-8ec7-206ebbb96d5e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:36.043744 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:36.047177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.047968 np0000003683 nova-compute[98991]: INFO os_vif [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf')
Jun 26 02:56:36.343032 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Detaching volume fb02ec99-ccf7-431e-8e6d-ce6b5593f717
Jun 26 02:56:36.393307 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to driver detach volume fb02ec99-ccf7-431e-8e6d-ce6b5593f717 from mountpoint /dev/vdc
Jun 26 02:56:36.430752 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'a5d387b7-a9ad-4a06-8504-93a902496c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'serial': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:56:36.436268 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdc by alias ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:36.437682 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdc by alias ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:36.437797 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attempting to detach device vdc from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <alias name="ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <serial>fb02ec99-ccf7-431e-8e6d-ce6b5593f717</serial>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="874d3b0e-34ab-4cd4-bd9c-bd6d2ed70eaf"/>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:36.438060 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:36.443754 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdc from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config.
Jun 26 02:56:36.443914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] (1/8): Attempting to detach device vdc with device alias ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <alias name="ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <target dev="vdc" bus="virtio"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <serial>fb02ec99-ccf7-431e-8e6d-ce6b5593f717</serial>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="874d3b0e-34ab-4cd4-bd9c-bd6d2ed70eaf"/>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:36.444275 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:36.513744 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.536270 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.629405 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.695235 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:36.695427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:36.695801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:36.695801 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:36.695891 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:56:36.696021 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-8d5ef9f4-29ce-4ca9-bacf-b54512d5b72d req-05d1dadc-2fc0-4463-8f72-e1dc2ade7e01 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received unexpected event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with vm_state active and task_state reboot_started_hard.
Jun 26 02:56:36.862131 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.866130 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:36.884788 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:37.056734 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 for instance a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:56:37.058524 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442597.0567944, a5d387b7-a9ad-4a06-8504-93a902496c23 => ua-fb02ec99-ccf7-431e-8e6d-ce6b5593f717> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:56:37.060864 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdc from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config.
Jun 26 02:56:37.066298 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:56:37.067313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:37.067313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:37.067313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:37.067721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:56:37.067805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:37.100207 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:56:37.100739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:37.102196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:37.103317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c47de40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:56:37.103605 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Removing multipathed devices sde, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:56:37.103930 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flush multipath device 330000000fc653794 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:56:37.150880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:37.210388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:37.269252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:56:37.269779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:56:37.271257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:56:37.282979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:56:37.283225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:37.294981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.336681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.40.100,3260]
Jun 26 02:56:37.336681 np0000003683 nova-compute[98991]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:37.336681 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.359795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.365232 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442597.3645372, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:37.365594 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Resumed (Lifecycle Event)
Jun 26 02:56:37.367333 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:56:37.373869 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance rebooted successfully.
Jun 26 02:56:37.376458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.383711 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:37.412443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.50.100,3260]
Jun 26 02:56:37.412443 np0000003683 nova-compute[98991]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:37.412443 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.428624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:37.430230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:37.430350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== disconnect_volume: return (363ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:37.430602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:56:37.869421 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:37.871564 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:56:37.996501 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:38.373924 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jun 26 02:56:38.374400 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442598.374156, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:38.374579 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Started (Lifecycle Event)
Jun 26 02:56:38.783881 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:38.784331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:38.784595 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:38.784769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:38.784910 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:56:38.785077 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-f3c6d397-5ef5-47f9-9309-014a57c34144 req-54f8ee66-f19c-403c-87d7-b62967200e28 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received unexpected event network-vif-plugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with vm_state active and task_state reboot_started_hard.
Jun 26 02:56:38.877797 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:38.882345 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:56:38.887343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:56:38.887628 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:56:38.887628 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:56:38.887751 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No VIF found with MAC fa:16:3e:8f:f0:d3, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:56:38.888228 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:39.007203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-f3d4e4fd-f7dd-4f0e-9d0f-53769ee6c0aa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.168s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:39.168401 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:39.168644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:39.386660 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jun 26 02:56:39.411766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8ea1d4ff-6408-4606-8108-bfc1b55b1c09 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 53.405s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:39.672752 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Detaching volume e468ef0f-cf10-4197-995e-7e9e013410e9
Jun 26 02:56:39.713795 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Attempting to driver detach volume e468ef0f-cf10-4197-995e-7e9e013410e9 from mountpoint /dev/vdb
Jun 26 02:56:39.717582 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-e468ef0f-cf10-4197-995e-7e9e013410e9 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:39.718725 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-e468ef0f-cf10-4197-995e-7e9e013410e9 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:56:39.718850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attempting to detach device vdb from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <alias name="ua-e468ef0f-cf10-4197-995e-7e9e013410e9"/>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <serial>e468ef0f-cf10-4197-995e-7e9e013410e9</serial>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:39.719078 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:39.723767 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the persistent domain config.
Jun 26 02:56:39.723900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] (1/8): Attempting to detach device vdb with device alias ua-e468ef0f-cf10-4197-995e-7e9e013410e9 from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <alias name="ua-e468ef0f-cf10-4197-995e-7e9e013410e9"/>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <serial>e468ef0f-cf10-4197-995e-7e9e013410e9</serial>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:56:39.724128 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:56:39.918887 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:39.919376 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:40.204924 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442600.2046065, a5d387b7-a9ad-4a06-8504-93a902496c23 => ua-e468ef0f-cf10-4197-995e-7e9e013410e9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:56:40.206585 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e468ef0f-cf10-4197-995e-7e9e013410e9 for instance a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:56:40.209050 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance a5d387b7-a9ad-4a06-8504-93a902496c23 from the live domain config.
Jun 26 02:56:40.210260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:56:40.210612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:40.210780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:40.211188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:40.211531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e468ef0f-cf10-4197-995e-7e9e013410e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:56:40.211657 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:40.241886 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash)
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash)
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:40.242183 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:56:40.242399 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:40.243129 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:56:40.243840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c4704a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:56:40.244048 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Removing multipathed devices sdd, sdc {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:56:40.244251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flush multipath device 330000000b0c2227f {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:56:40.276092 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:40.334990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:56:40.383998 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:56:40.384208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:56:40.385034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:56:40.402091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:56:40.402428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:56:40.415086 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.420953 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:56:40.454046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.40.100,3260]
Jun 26 02:56:40.454046 np0000003683 nova-compute[98991]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:40.454046 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.473746 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.487460 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.527026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.50.100,3260]
Jun 26 02:56:40.527026 np0000003683 nova-compute[98991]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:40.527026 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.556282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:40.556682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:40.556682 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== disconnect_volume: return (346ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:40.556824 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:56:40.998669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:40.998669 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:41.004190 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:56:41.004190 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Claim successful on node np0000003683
Jun 26 02:56:41.042355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:41.118292 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:42.126644 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d6a7d2fa-d52a-485c-855d-23a1a167c1c4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.958s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:42.183740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:42.184089 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:42.374493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:42.384025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:42.687537 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:43.196578 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.198s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:43.196921 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:56:43.704850 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:56:43.705058 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:56:43.705353 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:43.705629 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:43.780922 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:56:43.940778 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:44.207501 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:56:44.242446 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Successfully created port: 72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:56:44.712851 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:56:44.769182 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Successfully updated port: 72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:56:44.817673 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-changed-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:44.817802 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Refreshing instance network info cache due to event network-changed-72817169-4801-4bfa-82b6-247f0334c477. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:56:44.817976 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] Acquiring lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:56:44.818100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] Acquired lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:56:44.818282 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Refreshing network info cache for port 72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:56:45.216747 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Booting with volume 9ac36c3f-4110-4fc3-94ab-ccc825ff54fe at /dev/vda
Jun 26 02:56:45.264754 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:45.271370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:56:45.276590 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:56:45.302691 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:45.322213 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:45.363446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:56:45.363721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:56:45.373924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:56:45.374976 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe8f:f0d3', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:56:45.375178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:56:45.375295 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:56:45.375534 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:45.375725 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating existing volume attachment record: e1f6ba87-0eb8-49bb-90b1-9ff1af8f257c {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:56:45.419209 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:56:45.638185 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:45.903964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:45.904122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:45.904282 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:45.904369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:45.904490 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:45.908516 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Terminating instance
Jun 26 02:56:46.045009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.140347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6bd5e900-49a7-44b5-81e6-a1f28b0c5c6c req-32a5a0fa-cc90-4e44-af22-ce136c107ce0 service nova] Releasing lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:56:46.140650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:56:46.140788 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:56:46.415313 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:56:46.502703 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.524173 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.526848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.550373 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.711285 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:56:46.737737 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.744248 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:46.772214 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999628658999882 future=<Future at 0x72e27c4e57f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:56:46.772609 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999188368999967 future=<Future at 0x72e27c4e57f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:56:46.772720 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.9990672240001 future=<Future at 0x72e27c4e57f0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:56:46.774513 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Instance destroyed successfully.
Jun 26 02:56:46.775622 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'resources' on Instance uuid a5d387b7-a9ad-4a06-8504-93a902496c23 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:46.891295 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:46.895019 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:46.895234 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:46.895407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:46.895547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:46.895667 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:56:46.895776 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-e78726e2-7177-4bb1-8336-c4530a8f29b2 req-bf19f648-f82d-4e51-8a5e-368aedcd9ac9 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state building and task_state block_device_mapping.
Jun 26 02:56:47.103255 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating instance_info_cache with network_info: [{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:47.282731 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-213064390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-213064390',id=61,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHSMGufPnKFq+F2eJn5MfjNqVwMVRUv5/xw6aZweE2qSMr5abzxuSC9qD94FXifV5feNL2FMWY7lmW7/BIpt+IE2UYr4ZvtHKp1xNDGj6bjpyA45F7vRLm53iRrpkrMw==',key_name='tempest-keypair-1677032127',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:52:57Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-4pmsyoyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=a5d387b7-a9ad-4a06-8504-93a902496c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:56:47.282975 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "07d56f48-31a3-4499-9e44-ec684a89c432", "address": "fa:16:3e:2e:ea:a9", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d56f48-31", "ovs_interfaceid": "07d56f48-31a3-4499-9e44-ec684a89c432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:47.283740 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:47.284075 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:56:47.285650 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.285954 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07d56f48-31, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:47.286933 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.287726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:47.288572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.288761 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b165b9a-0b10-4ae6-8aa7-98409a0bb92b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:47.289509 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.289707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:47.289904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.293730 np0000003683 nova-compute[98991]: INFO os_vif [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ea:a9,bridge_name='br-int',has_traffic_filtering=True,id=07d56f48-31a3-4499-9e44-ec684a89c432,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d56f48-31')
Jun 26 02:56:47.294138 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Deleting instance files /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23_del
Jun 26 02:56:47.295231 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Deletion of /opt/stack/data/nova/instances/a5d387b7-a9ad-4a06-8504-93a902496c23_del complete
Jun 26 02:56:47.385451 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:47.499134 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:56:47.500260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:56:47.500418 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Creating image(s)
Jun 26 02:56:47.500716 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:56:47.500850 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Ensure instance console log exists: /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:56:47.501108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:47.501284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:47.501403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:47.606494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:56:47.606733 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance network_info: |[{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:56:47.607271 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start _get_guest_xml network_info=[{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1f6ba87-0eb8-49bb-90b1-9ff1af8f257c', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '09e776d5-a0a4-4e7a-b736-2e82b3d4236e', 'attached_at': '', 'detached_at': '', 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'serial': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:56:47.609672 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:56:47.610673 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1712919056', uuid='09e776d5-a0a4-4e7a-b736-2e82b3d4236e'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442607.6103723) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:56:47.612162 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:56:47.612455 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:56:47.613317 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:56:47.613474 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:56:47.614279 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:56:47.614528 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:56:47.614652 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:56:47.614731 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:56:47.614851 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:56:47.614955 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:56:47.615089 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:56:47.615283 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:56:47.615416 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:56:47.615566 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:56:47.616136 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:56:47.616136 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:56:47.625050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:56:47.625314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:56:47.625444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:47.625781 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:47.625968 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:56:47.637250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:47.637958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:56:47.638555 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:47.638880 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:56:47.639378 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:56:47.639715 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:56:47.656126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:56:47.656126 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:47.656943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:56:47.656943 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe] added
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:47.668954 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:47.669220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:56:47.669367 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:56:47.669531 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe] added
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:56:47.671884 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:47.672155 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:56:47.672229 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:56:47.672367 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:56:47.801644 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 26 02:56:47.802175 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:56:47.802494 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:56:47.802622 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:56:47.802842 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:47.925072 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:48.003850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:48.212590 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5b572c2-3931-408f-9247-0a76757ed038 req-c4318b27-eb4a-4076-aeec-6a214f4de529 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Received event network-vif-deleted-07d56f48-31a3-4499-9e44-ec684a89c432 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:48.212848 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-b5b572c2-3931-408f-9247-0a76757ed038 req-c4318b27-eb4a-4076-aeec-6a214f4de529 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Neutron deleted interface 07d56f48-31a3-4499-9e44-ec684a89c432; detaching it from the instance and deleting it from the info cache
Jun 26 02:56:48.215513 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b5b572c2-3931-408f-9247-0a76757ed038 req-c4318b27-eb4a-4076-aeec-6a214f4de529 service nova] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Detach interface failed, port_id=07d56f48-31a3-4499-9e44-ec684a89c432, reason: Instance a5d387b7-a9ad-4a06-8504-93a902496c23 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:56:48.661128 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:48.669888 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:56:48.672895 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:56:48.687298 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:56:48.693630 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.702294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.713527 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.720792 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:48.730057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.730057 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.730057 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:48.730207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.730207 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.730207 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:48.760295 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260]
Jun 26 02:56:48.760295 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260] successful.
Jun 26 02:56:48.760295 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.771826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.777313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260]
Jun 26 02:56:48.777313 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260] successful.
Jun 26 02:56:48.777313 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.785588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.785588 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.785588 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.785588 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.785588 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:48.785772 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.785772 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.785772 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.785772 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.785772 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:48.785947 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:48.786064 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:56:48.786674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('7', '-', '-', 0) found on session 189 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:56:48.786788 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:56:48.793186 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:56:48.804211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 189 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:56:48.804211 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:56:48.808127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.808127 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.808127 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.808127 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.808127 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:56:48.808274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.808274 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:56:48.808274 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.808274 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:56:48.808274 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:56:48.808450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:48.808710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:56:48.809080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('8', '-', '-', 0) found on session 190 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:56:48.809175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:56:48.823162 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 190 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:56:48.823162 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:56:49.163260 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Took 1.36 seconds to deallocate network for instance.
Jun 26 02:56:49.639131 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:56:49.670905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:49.671502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:49.871840 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:49.872141 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:50.374837 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:50.657474 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000866cc253 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:56:50.659420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:56:50.659420 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000866cc253', 'path': '/dev/dm-0', 'multipath_id': '330000000866cc253'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:56:50.659420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000866cc253', 'path': '/dev/dm-0', 'multipath_id': '330000000866cc253'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:56:50.882918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.212s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:50.947989 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Deleted allocations for instance a5d387b7-a9ad-4a06-8504-93a902496c23
Jun 26 02:56:51.164137 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:56:51.164470 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:51.165058 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:51.165696 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <uuid>09e776d5-a0a4-4e7a-b736-2e82b3d4236e</uuid>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <name>instance-00000045</name>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1712919056</nova:name>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:56:47</nova:creationTime>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         <nova:port uuid="72817169-4801-4bfa-82b6-247f0334c477">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="serial">09e776d5-a0a4-4e7a-b736-2e82b3d4236e</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="uuid">09e776d5-a0a4-4e7a-b736-2e82b3d4236e</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <alias name="ua-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <serial>9ac36c3f-4110-4fc3-94ab-ccc825ff54fe</serial>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:18:af:4d"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <target dev="tap72817169-48"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/console.log" append="off"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:56:51.668608 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Preparing to wait for external event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:51.670956 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:51.671259 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:56:51.671492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.671691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:51.671840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:56:51.672375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.672500 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ca9bffd-ff11-5f63-aae3-b64d1acab3b9', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:51.673218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.673955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:51.674089 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.675828 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.675966 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72817169-48, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:51.676279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72817169-48, col_values=(('qos', UUID('75edf374-fa6a-42b9-901e-d6fe9a3b33ea')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:51.676447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72817169-48, col_values=(('external_ids', {'iface-id': '72817169-4801-4bfa-82b6-247f0334c477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:af:4d', 'vm-uuid': '09e776d5-a0a4-4e7a-b736-2e82b3d4236e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:51.677215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.678591 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:51.683737 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:51.684447 np0000003683 nova-compute[98991]: INFO os_vif [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48')
Jun 26 02:56:51.743558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:51.743909 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:51.958738 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a480e47e-62f0-4625-a04f-e26b597f64fa tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "a5d387b7-a9ad-4a06-8504-93a902496c23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.054s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:52.245792 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:56:52.387067 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:52.792335 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:52.792520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:52.795485 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:56:52.795673 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Claim successful on node np0000003683
Jun 26 02:56:53.202285 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:56:53.202756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:56:53.202756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:18:af:4d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:56:53.202970 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Using config drive
Jun 26 02:56:53.707957 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:53.821065 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Creating config drive at /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config
Jun 26 02:56:53.825082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcrud7xmy {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:53.890685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcrud7xmy" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:54.031450 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:54.031803 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:54.340516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.346396 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:54.347206 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:54.365726 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.366004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.450102 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.535921 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:54.587424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ef364abf-8818-4587-8d72-8990fcaebb3a req-b33505e4-0922-44f6-a2f7-7c6c62b596e3 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:54.587599 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef364abf-8818-4587-8d72-8990fcaebb3a req-b33505e4-0922-44f6-a2f7-7c6c62b596e3 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:54.587784 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef364abf-8818-4587-8d72-8990fcaebb3a req-b33505e4-0922-44f6-a2f7-7c6c62b596e3 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:54.588246 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ef364abf-8818-4587-8d72-8990fcaebb3a req-b33505e4-0922-44f6-a2f7-7c6c62b596e3 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:54.588403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ef364abf-8818-4587-8d72-8990fcaebb3a req-b33505e4-0922-44f6-a2f7-7c6c62b596e3 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Processing event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:56:54.658922 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.660534 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.662968 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:54.682259 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:55.044069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.251s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:55.044623 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:56:55.119111 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:56:55.120264 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442615.1197681, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:55.120459 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Started (Lifecycle Event)
Jun 26 02:56:55.122045 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:56:55.124347 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance spawned successfully.
Jun 26 02:56:55.124660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:56:55.343891 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:55.344408 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:56:55.344408 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:56:55.549786 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:56:55.551437 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:56:55.552065 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:55.552065 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:55.624831 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:55.631948 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:56:55.635443 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4eb6a96c0c94530a4b3a32ab643cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d962a595245afbe319c15ac2ccc1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:56:55.638033 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:55.638215 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:55.638615 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:55.638889 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:55.639226 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:55.639535 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:56:56.055881 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:56:56.137365 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:56:56.140033 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442616.137459, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:56.140033 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Paused (Lifecycle Event)
Jun 26 02:56:56.144940 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Took 8.65 seconds to spawn the instance on the hypervisor.
Jun 26 02:56:56.146726 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:56.175720 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Successfully created port: 72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:56:56.559469 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:56:56.640178 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:56.642042 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442616.6417062, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:56:56.642175 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Resumed (Lifecycle Event)
Jun 26 02:56:56.661238 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Took 15.74 seconds to build instance.
Jun 26 02:56:56.666355 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:56.666721 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:56.666957 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:56.667134 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:56.667349 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:56:56.667575 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-163af6ae-061e-4756-b4c6-48989d3f65a3 req-e8562945-bdf0-48c7-8518-2c45c38d0819 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state active and task_state None.
Jun 26 02:56:56.679622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:56.695854 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Successfully updated port: 72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:56:56.774880 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-changed-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:56.775234 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Refreshing instance network info cache due to event network-changed-72204700-32a0-40e5-a89d-3bbda357e9a5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:56:56.775440 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] Acquiring lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:56:56.775593 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] Acquired lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:56:56.775744 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Refreshing network info cache for port 72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:56:56.892695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:56.892939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:57.144387 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:56:57.146372 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:56:57.167037 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b965f6a-5783-4367-92f7-31732f2ebc44 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.248s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:57.197937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:56:57.277447 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:57.344506 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:56:57.347355 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:56:57.388168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:57.394526 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:56:57.508594 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:57.568650 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:56:57.569125 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:56:57.569125 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Creating image(s)
Jun 26 02:56:57.570106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:57.570106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:57.570305 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:57.570968 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:56:57.574802 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:56:57.576057 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:57.677130 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:57.677609 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:57.678259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:57.678600 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:56:57.682185 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:56:57.682575 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:57.775819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.093s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:57.776490 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:57.841106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk 1073741824" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:57.841566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:57.842370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:57.867605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:57.867605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:57.867605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:57.867605 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:56:57.944067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:57.944431 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:56:57.944699 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:57.986939 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:57.987314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:57.995116 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:56:57.995321 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Claim successful on node np0000003683
Jun 26 02:56:58.013499 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-77b642a2-2ad3-459f-b936-5e1769a5d898 req-3f23a77a-9779-4f81-abaa-b0622e1a4865 service nova] Releasing lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:56:58.014129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquired lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:56:58.014335 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:56:58.063897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:58.064315 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Cannot resize image /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:56:58.064675 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:56:58.064900 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Ensure instance console log exists: /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:56:58.066466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:58.066466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:58.066466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:58.586245 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:56:58.721238 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-changed-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:56:58.721512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Refreshing instance network info cache due to event network-changed-72817169-4801-4bfa-82b6-247f0334c477. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:56:58.721684 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] Acquiring lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:56:58.721769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] Acquired lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:56:58.721881 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Refreshing network info cache for port 72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:56:58.741148 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:58.860208 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating instance_info_cache with network_info: [{"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:58.907184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:56:58.908707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:59.000621 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:59.001124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:59.093569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:59.093987 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:56:59.099727 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:56:59.100825 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:56:59.166526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:56:59.167022 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51305MB free_disk=71.81757354736328GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:56:59.167241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:59.226195 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:59.298446 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:56:59.298710 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:56:59.364512 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Releasing lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:56:59.365238 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance network_info: |[{"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:56:59.367435 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Start _get_guest_xml network_info=[{"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:56:59.369722 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:56:59.370879 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-380292941', uuid='0534b0e4-b1ef-4546-9061-731ba488cdf9'), owner=OwnerMeta(userid='c4eb6a96c0c94530a4b3a32ab643cc10', username='tempest-SnapshotDataIntegrityTests-1423257265-project-member', projectid='884d962a595245afbe319c15ac2ccc1f', projectname='tempest-SnapshotDataIntegrityTests-1423257265'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442619.3705597) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:56:59.371957 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:56:59.372322 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:56:59.373261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:56:59.373464 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:56:59.374620 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:56:59.374960 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:56:59.375179 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:56:59.375311 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:56:59.375468 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:56:59.375599 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:56:59.375754 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:56:59.375952 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:56:59.376132 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:56:59.376333 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:56:59.376520 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:56:59.376674 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:56:59.386972 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380292941',display_name='tempest-SnapshotDataIntegrityTests-server-380292941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-snapshotdataintegritytests-server-380292941',id=70,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIWGDaoof8v+p0Ju/sR9snJLSfs6hTdmACs2bsn6r93GeZMXoQmAbWqPS8+uBan0Pa/JfO0rVARRGYymODpnEBetL8j/b5mNkYUW5P8wsTxp1raxh8ur2c9znT2TJvFlA==',key_name='tempest-keypair-1245171642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='884d962a595245afbe319c15ac2ccc1f',ramdisk_id='',reservation_id='r-ygx8tjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1423257265',owner_user_name='tempest-SnapshotDataIntegrityTests-1423257265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4eb6a96c0c94530a4b3a32ab643cc10',uuid=0534b0e4-b1ef-4546-9061-731ba488cdf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:56:59.387212 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converting VIF {"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:59.387787 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:59.388375 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'pci_devices' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:56:59.521923 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:56:59.656136 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updated VIF entry in instance network info cache for port 72817169-4801-4bfa-82b6-247f0334c477. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:56:59.656588 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating instance_info_cache with network_info: [{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:56:59.805484 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <uuid>0534b0e4-b1ef-4546-9061-731ba488cdf9</uuid>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <name>instance-00000046</name>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-380292941</nova:name>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:56:59</nova:creationTime>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:user uuid="c4eb6a96c0c94530a4b3a32ab643cc10">tempest-SnapshotDataIntegrityTests-1423257265-project-member</nova:user>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:project uuid="884d962a595245afbe319c15ac2ccc1f">tempest-SnapshotDataIntegrityTests-1423257265</nova:project>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         <nova:port uuid="72204700-32a0-40e5-a89d-3bbda357e9a5">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="serial">0534b0e4-b1ef-4546-9061-731ba488cdf9</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="uuid">0534b0e4-b1ef-4546-9061-731ba488cdf9</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.config"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:1f:2e:0d"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <target dev="tap72204700-32"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/console.log" append="off"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:56:59.891890 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:56:59.894648 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Preparing to wait for external event network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:56:59.894912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:56:59.895218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:56:59.895483 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:56:59.896380 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380292941',display_name='tempest-SnapshotDataIntegrityTests-server-380292941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-snapshotdataintegritytests-server-380292941',id=70,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIWGDaoof8v+p0Ju/sR9snJLSfs6hTdmACs2bsn6r93GeZMXoQmAbWqPS8+uBan0Pa/JfO0rVARRGYymODpnEBetL8j/b5mNkYUW5P8wsTxp1raxh8ur2c9znT2TJvFlA==',key_name='tempest-keypair-1245171642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='884d962a595245afbe319c15ac2ccc1f',ramdisk_id='',reservation_id='r-ygx8tjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1423257265',owner_user_name='tempest-SnapshotDataIntegrityTests-1423257265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4eb6a96c0c94530a4b3a32ab643cc10',uuid=0534b0e4-b1ef-4546-9061-731ba488cdf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:56:59.896547 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converting VIF {"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:56:59.897009 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:56:59.897273 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:56:59.897643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.897930 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:59.898225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:56:59.899901 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.900098 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b258c68-f3e8-53eb-9d4d-55ad91931a54', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:59.900862 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.901536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:59.901872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.904045 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.904133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72204700-32, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:59.904455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72204700-32, col_values=(('qos', UUID('19110a56-24aa-48cc-be52-edb2ab0e576b')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:59.904653 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72204700-32, col_values=(('external_ids', {'iface-id': '72204700-32a0-40e5-a89d-3bbda357e9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2e:0d', 'vm-uuid': '0534b0e4-b1ef-4546-9061-731ba488cdf9'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:56:59.905482 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.906718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:56:59.912490 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:56:59.913420 np0000003683 nova-compute[98991]: INFO os_vif [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32')
Jun 26 02:57:00.158526 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-742b9eb4-540e-4886-98fc-9f94522137f0 req-dc73dfb1-9d44-4758-ac9e-4ff60d94d1db service nova] Releasing lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:00.312353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.325s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:00.313060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.145s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:00.313645 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:57:00.823876 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:57:00.824354 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:57:00.824625 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:00.824913 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:00.914748 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145815cb362e40ad95db2c64431821bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87599dd62cac4c0d9bfad984dc67bf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:57:01.324715 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:57:01.394786 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:57:01.394786 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 09e776d5-a0a4-4e7a-b736-2e82b3d4236e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:57:01.396960 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:57:01.396960 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 21df308b-5507-4700-990f-8ec3d8a12587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:57:01.396960 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:57:01.397411 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:56:59 up 43 min,  2 users,  load average: 2.99, 5.61, 4.91\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_7b27156fe7ab4391b30a0b973577b79c': '1', 'io_workload': '2', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_884d962a595245afbe319c15ac2ccc1f': '1', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:57:01.434577 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:01.434774 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:01.434774 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No VIF found with MAC fa:16:3e:1f:2e:0d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:01.435189 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Using config drive
Jun 26 02:57:01.446692 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Successfully created port: 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:57:01.664910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:57:01.665159 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:57:01.772317 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004763910001202021 future=<Future at 0x72e27c4e57f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:01.772457 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:01.773042 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Emitting event <LifecycleEvent: 1782442606.771718, a5d387b7-a9ad-4a06-8504-93a902496c23 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:01.773286 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] VM Stopped (Lifecycle Event)
Jun 26 02:57:01.831550 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:57:01.940435 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:02.017495 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Successfully updated port: 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:57:02.070541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-changed-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:02.071016 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Refreshing instance network info cache due to event network-changed-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:02.071228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] Acquiring lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:02.071345 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] Acquired lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:02.071470 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Refreshing network info cache for port 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:02.091500 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Creating config drive at /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.config
Jun 26 02:57:02.095207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2x18f2i0 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:02.152760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2x18f2i0" returned: 0 in 0.057s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:02.169065 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:57:02.280614 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a2c6f9ae-905f-4fc8-9cdc-f9981e494644 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: a5d387b7-a9ad-4a06-8504-93a902496c23] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:02.399113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:02.523127 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:02.573981 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:02.578904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:02.605015 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:02.665048 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:57:02.677241 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:57:02.677506 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.365s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:02.678287 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:57:02.708135 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:02.794368 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-305bbfff-ff60-4b1a-9175-b77912795c20 req-48bbb577-ed7c-428a-86ca-e89cebf8d519 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:02.795523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-305bbfff-ff60-4b1a-9175-b77912795c20 req-48bbb577-ed7c-428a-86ca-e89cebf8d519 service nova] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:02.795523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-305bbfff-ff60-4b1a-9175-b77912795c20 req-48bbb577-ed7c-428a-86ca-e89cebf8d519 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:02.795523 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-305bbfff-ff60-4b1a-9175-b77912795c20 req-48bbb577-ed7c-428a-86ca-e89cebf8d519 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:02.795523 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-305bbfff-ff60-4b1a-9175-b77912795c20 req-48bbb577-ed7c-428a-86ca-e89cebf8d519 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Processing event network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:57:02.842038 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:57:02.843814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:57:02.844129 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Creating image(s)
Jun 26 02:57:02.844820 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:02.846120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:02.846120 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:02.846320 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:02.850139 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:02.851657 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:02.886626 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:02.954265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:02.954786 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:02.955265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:02.956140 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:02.960183 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:02.960183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:02.980583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:03.002661 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:03.085603 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.126s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:03.086070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:03.148959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk 1073741824" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:03.149500 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:03.149835 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:03.265190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:03.265690 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:57:03.265978 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:03.372571 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:03.375371 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Cannot resize image /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:57:03.377801 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:57:03.378251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Ensure instance console log exists: /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:57:03.378571 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:03.380233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:03.380457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:03.390111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-60a497db-e93b-4f41-b3c8-d7cb146a47af req-972c3c76-c364-41f7-84a7-d6776f7d2acd service nova] Releasing lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:03.390897 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquired lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:03.391195 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:57:03.430166 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442623.4287515, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:03.430342 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] VM Started (Lifecycle Event)
Jun 26 02:57:03.431285 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:57:03.433865 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:57:03.436020 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance spawned successfully.
Jun 26 02:57:03.436273 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:57:03.933592 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:03.936248 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:03.945871 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.946184 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.946719 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.947125 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.947549 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.947984 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:03.964076 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:57:04.186158 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:04.334340 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updating instance_info_cache with network_info: [{"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:04.439273 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:57:04.439885 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442624.4396775, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:04.440048 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] VM Paused (Lifecycle Event)
Jun 26 02:57:04.453859 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Took 6.89 seconds to spawn the instance on the hypervisor.
Jun 26 02:57:04.454038 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:04.678559 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:04.678781 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:04.679114 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:04.679376 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:04.679623 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:04.679949 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.66 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:57:04.836255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Releasing lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:04.836545 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance network_info: |[{"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:57:04.838074 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Start _get_guest_xml network_info=[{"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:57:04.840606 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:57:04.841681 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1202906500', uuid='21df308b-5507-4700-990f-8ec3d8a12587'), owner=OwnerMeta(userid='145815cb362e40ad95db2c64431821bc', username='tempest-VolumeMultiattachTests-190007800-project-member', projectid='87599dd62cac4c0d9bfad984dc67bf67', projectname='tempest-VolumeMultiattachTests-190007800'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442624.8413534) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:57:04.842838 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:57:04.843174 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:57:04.844143 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:57:04.844342 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:57:04.845185 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:57:04.845463 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:57:04.845602 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:57:04.845695 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:57:04.845796 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:57:04.845875 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:57:04.846015 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:57:04.846161 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:57:04.846251 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:57:04.846350 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:57:04.846446 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:57:04.846564 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:57:04.861435 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1202906500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-1202906500',id=71,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWzIJx8doEsyE08okB1RHeYJHBXcmxxPCibOBOAk15kefo2AkyjY/oSJcgcFbffAjb79RwC7A/ax+gVa4ydELnnSffCmMc6Hr6P7Gc2jdU45rDm4gNIK6zCULS7mFJ9rw==',key_name='tempest-keypair-1855948039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-8lhqbnxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=21df308b-5507-4700-990f-8ec3d8a12587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:57:04.861675 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:04.862719 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:04.863412 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'pci_devices' on Instance uuid 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:04.879702 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:04.880293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:04.880769 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:04.881074 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:04.881270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] No waiting events found dispatching network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:04.881472 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-783af74f-7ed0-46fd-a7bd-463fc519b0f7 req-871cf4e7-ea87-4c95-a86f-9169fa5ce60a service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received unexpected event network-vif-plugged-72204700-32a0-40e5-a89d-3bbda357e9a5 for instance with vm_state active and task_state None.
Jun 26 02:57:04.906499 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:04.942426 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:04.944512 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442624.9442651, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:04.944770 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] VM Resumed (Lifecycle Event)
Jun 26 02:57:04.964584 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Took 12.21 seconds to build instance.
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <uuid>21df308b-5507-4700-990f-8ec3d8a12587</uuid>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <name>instance-00000047</name>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:name>tempest-VolumeMultiattachTests-server-1202906500</nova:name>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:57:04</nova:creationTime>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:user uuid="145815cb362e40ad95db2c64431821bc">tempest-VolumeMultiattachTests-190007800-project-member</nova:user>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:project uuid="87599dd62cac4c0d9bfad984dc67bf67">tempest-VolumeMultiattachTests-190007800</nova:project>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         <nova:port uuid="4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="serial">21df308b-5507-4700-990f-8ec3d8a12587</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="uuid">21df308b-5507-4700-990f-8ec3d8a12587</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.config"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:32:ed:4f"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <target dev="tap4b9c4b6d-71"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/console.log" append="off"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:57:05.367829 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Preparing to wait for external event network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1202906500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-1202906500',id=71,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWzIJx8doEsyE08okB1RHeYJHBXcmxxPCibOBOAk15kefo2AkyjY/oSJcgcFbffAjb79RwC7A/ax+gVa4ydELnnSffCmMc6Hr6P7Gc2jdU45rDm4gNIK6zCULS7mFJ9rw==',key_name='tempest-keypair-1855948039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-8lhqbnxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=21df308b-5507-4700-990f-8ec3d8a12587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:05.370808 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:05.371541 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:57:05.371541 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.371746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:05.371986 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:57:05.372787 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.373110 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd779012b-1673-5f6d-a32e-7fdf68865e59', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:05.386771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.387956 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:05.390784 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.391064 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b9c4b6d-71, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:05.391555 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b9c4b6d-71, col_values=(('qos', UUID('8b923d62-7ba3-4443-a623-365d4cd4a88e')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:05.391827 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b9c4b6d-71, col_values=(('external_ids', {'iface-id': '4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:ed:4f', 'vm-uuid': '21df308b-5507-4700-990f-8ec3d8a12587'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:05.392685 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.396189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:05.398684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:05.399588 np0000003683 nova-compute[98991]: INFO os_vif [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71')
Jun 26 02:57:05.447312 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:05.449487 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:05.466174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.722s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:06.274403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-changed-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:06.274748 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Refreshing instance network info cache due to event network-changed-72204700-32a0-40e5-a89d-3bbda357e9a5. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:06.274780 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] Acquiring lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:06.274924 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] Acquired lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:06.275344 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Refreshing network info cache for port 72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:06.778802 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:06.915853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:06.916000 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:06.916141 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:32:ed:4f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:06.916656 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Using config drive
Jun 26 02:57:07.131229 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:07.259265 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updated VIF entry in instance network info cache for port 72204700-32a0-40e5-a89d-3bbda357e9a5. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:57:07.259545 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating instance_info_cache with network_info: [{"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:07.401016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:07.421695 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:07.551740 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Creating config drive at /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.config
Jun 26 02:57:07.556855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicbx6h3t {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:07.618240 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicbx6h3t" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:07.761931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-070fd546-0988-493b-a042-ee4b3f986b58 req-1cba49cc-0d5b-418e-bee0-4b2a67e369f4 service nova] Releasing lock "refresh_cache-0534b0e4-b1ef-4546-9061-731ba488cdf9" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:08.060548 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.097336 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.203796 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.302505 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fff5f8ce-3cde-44fe-9815-72ff714c617f req-258c58c0-d9ce-4131-9776-dd72b7ea5481 service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:08.302857 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fff5f8ce-3cde-44fe-9815-72ff714c617f req-258c58c0-d9ce-4131-9776-dd72b7ea5481 service nova] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:08.303204 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fff5f8ce-3cde-44fe-9815-72ff714c617f req-258c58c0-d9ce-4131-9776-dd72b7ea5481 service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:08.303338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fff5f8ce-3cde-44fe-9815-72ff714c617f req-258c58c0-d9ce-4131-9776-dd72b7ea5481 service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:08.303873 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fff5f8ce-3cde-44fe-9815-72ff714c617f req-258c58c0-d9ce-4131-9776-dd72b7ea5481 service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Processing event network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:57:08.452537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.455012 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.458355 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.476328 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:08.796267 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:57:08.796952 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442628.79653, 21df308b-5507-4700-990f-8ec3d8a12587 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:08.797163 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] VM Started (Lifecycle Event)
Jun 26 02:57:08.798653 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:57:08.802609 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance spawned successfully.
Jun 26 02:57:08.803081 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:57:09.299997 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:09.302956 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:09.310793 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.310932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.311335 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.311629 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.311932 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.312249 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:09.807787 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:57:09.808367 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442629.8077374, 21df308b-5507-4700-990f-8ec3d8a12587 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:09.808367 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] VM Paused (Lifecycle Event)
Jun 26 02:57:09.818636 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Took 6.98 seconds to spawn the instance on the hypervisor.
Jun 26 02:57:09.818636 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:10.311295 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:10.313607 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442630.3133035, 21df308b-5507-4700-990f-8ec3d8a12587 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:10.313829 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] VM Resumed (Lifecycle Event)
Jun 26 02:57:10.328128 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Took 12.43 seconds to build instance.
Jun 26 02:57:10.375518 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:10.375905 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:10.376113 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:10.376266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:10.376433 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] No waiting events found dispatching network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:10.376620 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-b54e01b6-67cc-4f5f-ba9c-707853afd108 req-0b347c5e-f480-42f3-af07-140fbed528ad service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received unexpected event network-vif-plugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 for instance with vm_state active and task_state None.
Jun 26 02:57:10.393448 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:10.818023 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:10.823413 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:10.829235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cb39dbb9-0d2b-410c-96a8-48691cc42ec4 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.936s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:12.409375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:12.468995 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-changed-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:12.469568 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Refreshing instance network info cache due to event network-changed-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:12.469806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] Acquiring lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:12.469944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] Acquired lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:12.470161 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Refreshing network info cache for port 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:12.973786 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:13.281381 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:13.403124 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updated VIF entry in instance network info cache for port 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:57:13.403381 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updating instance_info_cache with network_info: [{"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:13.906842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-fa89274a-34c5-4fc0-ad87-09488838b268 req-4c1bd41c-7ea7-43ea-9a52-bb29b5d6f29d service nova] Releasing lock "refresh_cache-21df308b-5507-4700-990f-8ec3d8a12587" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:15.394422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:16.917732 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:16.917732 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing instance network info cache due to event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:16.920829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:16.920829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:16.920829 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:17.410845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:17.422557 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:17.456713 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:17.456885 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing instance network info cache due to event network-changed-d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:17.457154 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] Acquiring lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:17.762460 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:17.916655 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updated VIF entry in instance network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:57:17.916926 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:18.083270 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:18.083850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:18.419153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-27d68c25-0ac9-4555-8c49-be7858c3ae79 req-8a6b0946-c843-471d-8e7f-3cc0e521a53f service nova] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:18.419471 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] Acquired lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:18.419907 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Refreshing network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:18.585843 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Detaching volume 3fd9685d-5bc2-4eb3-9b3c-49bfede5b363
Jun 26 02:57:18.626357 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Attempting to driver detach volume 3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 from mountpoint /dev/vdb
Jun 26 02:57:18.635786 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found disk vdb by alias ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:57:18.637293 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found disk vdb by alias ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:57:18.637458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Attempting to detach device vdb from instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <alias name="ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363"/>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <serial>3fd9685d-5bc2-4eb3-9b3c-49bfede5b363</serial>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:57:18.637814 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:57:18.644124 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully detached device vdb from instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e from the persistent domain config.
Jun 26 02:57:18.644316 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] (1/8): Attempting to detach device vdb with device alias ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 from instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <alias name="ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363"/>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-2"/>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <serial>3fd9685d-5bc2-4eb3-9b3c-49bfede5b363</serial>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:57:18.644591 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:57:18.922706 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:19.188610 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442639.1882033, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:57:19.190341 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 for instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:57:19.193060 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully detached device vdb from instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e from the live domain config.
Jun 26 02:57:19.194305 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:57:19.194634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:19.194780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:19.195224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:19.195563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:57:19.195704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:57:19.223160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:57:19.223160 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:57:19.223160 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:19.223160 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:19.223160 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:19.223370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:57:19.223370 np0000003683 nova-compute[98991]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash)
Jun 26 02:57:19.223370 np0000003683 nova-compute[98991]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:19.223370 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:19.223370 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:19.223580 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '190')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:57:19.223726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:19.224685 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:19.225356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c470a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:57:19.225572 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:57:19.225912 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flush multipath device 330000000e4736b49 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:57:19.232747 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:19.264902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:19.324081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:19.382105 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:57:19.382251 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:57:19.383110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:57:19.395161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:57:19.395375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:57:19.399358 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updated VIF entry in instance network info cache for port d8d5ef87-bf20-4565-8d3c-21933a1412ba. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:57:19.399711 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [{"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:19.411577 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.445547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260]
Jun 26 02:57:19.445547 np0000003683 nova-compute[98991]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:19.445547 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.462758 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.478359 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.516919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260]
Jun 26 02:57:19.516919 np0000003683 nova-compute[98991]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:19.516919 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.533737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:19.534074 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:19.534258 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== disconnect_volume: return (339ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:19.534428 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:57:19.901706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff193f95-48f9-4da3-acbf-8f201d2de235 req-4ac3195a-3e7d-4679-873e-be07a316a53b service nova] Releasing lock "refresh_cache-d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:20.082908 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:20.408885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:21.089700 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3df2fa5a-58c3-4313-a458-bd40dbbc058c tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.005s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:22.413411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:22.480446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:22.480601 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:22.480805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:22.480971 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:22.481166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:22.483201 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Terminating instance
Jun 26 02:57:22.986072 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:57:23.024173 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.047161 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.071805 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.197906 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:23.198150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:23.198344 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:23.198487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:23.198659 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:23.198831 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-517c643e-8c8d-4c91-a09f-55f209c1479d req-75c68101-1973-4119-971f-14e21cde894d service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:57:23.317983 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.325844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.348234 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999707756000134 future=<Future at 0x72e27c182510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:23.348584 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999321366999993 future=<Future at 0x72e27c182510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:23.348699 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999209319000329 future=<Future at 0x72e27c182510 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:23.350706 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Instance destroyed successfully.
Jun 26 02:57:23.351117 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'resources' on Instance uuid d46927ca-f4f7-4df7-8ec7-206ebbb96d5e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:23.853494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:55:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557685198',display_name='tempest-TestMinimumBasicScenario-server-557685198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-557685198',id=68,image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWL8cuigHFd2cfYgqlyaLr47ZiIxVPT10ABXqNB10OyT/WhOT2Vpgquwz61XhLStzj8DOktBZ0HiRgQmL1O36kc41PrzctmNGfWHccUJcVUciCl7wdU28TUkXuOAs273g==',key_name='tempest-TestMinimumBasicScenario-14158103',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:55:17Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-dh1mbjqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3997ee2d-4074-4fef-8cbd-59663eca50b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:56:39Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=d46927ca-f4f7-4df7-8ec7-206ebbb96d5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:57:23.854025 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "address": "fa:16:3e:8f:f0:d3", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d5ef87-bf", "ovs_interfaceid": "d8d5ef87-bf20-4565-8d3c-21933a1412ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:23.854305 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:23.854565 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:57:23.856393 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.856690 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8d5ef87-bf, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:23.857735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.858850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:23.859793 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.860638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.860808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e2dddd1-afbf-437a-911a-af8d1a203d21) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:23.861988 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:23.862692 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:23.864271 np0000003683 nova-compute[98991]: INFO os_vif [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:f0:d3,bridge_name='br-int',has_traffic_filtering=True,id=d8d5ef87-bf20-4565-8d3c-21933a1412ba,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8d5ef87-bf')
Jun 26 02:57:23.864622 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Deleting instance files /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e_del
Jun 26 02:57:23.865364 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Deletion of /opt/stack/data/nova/instances/d46927ca-f4f7-4df7-8ec7-206ebbb96d5e_del complete
Jun 26 02:57:24.371382 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 26 02:57:24.371940 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:57:24.372270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:57:24.372370 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:57:24.372596 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:24.434098 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:24.763009 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0730be21-6cda-471a-80de-782ca3418974 req-2b335966-3146-4212-9792-516e08b36ef3 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-deleted-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:24.763512 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-0730be21-6cda-471a-80de-782ca3418974 req-2b335966-3146-4212-9792-516e08b36ef3 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Neutron deleted interface d8d5ef87-bf20-4565-8d3c-21933a1412ba; detaching it from the instance and deleting it from the info cache
Jun 26 02:57:24.765305 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0730be21-6cda-471a-80de-782ca3418974 req-2b335966-3146-4212-9792-516e08b36ef3 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Detach interface failed, port_id=d8d5ef87-bf20-4565-8d3c-21933a1412ba, reason: Instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:57:25.212796 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:25.259245 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:25.259430 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] Acquiring lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:25.259615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:25.259734 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:25.259854 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] No waiting events found dispatching network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:25.259978 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c0c907a2-1ed2-4edb-916b-871badecd75a req-81c88be9-af4d-4709-82ae-fb093353d012 service nova] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Received event network-vif-unplugged-d8d5ef87-bf20-4565-8d3c-21933a1412ba for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:57:25.715022 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Took 1.34 seconds to deallocate network for instance.
Jun 26 02:57:26.220418 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:26.220892 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:26.444856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:57:26.445244 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:57:26.948422 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:57:27.415141 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:27.454558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.234s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:27.513171 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Deleted allocations for instance d46927ca-f4f7-4df7-8ec7-206ebbb96d5e
Jun 26 02:57:28.522637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5bbe8d46-4365-4ce1-a632-cfa5480e6c4a tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "d46927ca-f4f7-4df7-8ec7-206ebbb96d5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.042s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:28.862762 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:32.105533 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:32.105834 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:32.416834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:32.608295 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:57:32.703603 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:33.153735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:33.154147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:33.157664 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:57:33.157810 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Claim successful on node np0000003683
Jun 26 02:57:33.864095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:34.390158 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:57:34.390520 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:57:34.727174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:34.727356 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:34.727519 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:34.729486 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98991) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 26 02:57:34.729962 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'flavor' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:34.892766 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:57:35.398602 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.245s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:35.399060 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:57:35.758697 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:35.782318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:35.789218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:35.818393 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:35.904755 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:57:35.905889 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:57:35.906222 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:35.906528 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:35.923065 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:35.923868 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:35.924129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:35.924289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:35.924445 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:35.924743 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-c231a106-a6cf-464a-b33d-4753463d1285 req-67908bf9-e70e-4b39-b713-16b50b46e986 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state active and task_state powering-off.
Jun 26 02:57:36.003883 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c6f720766e94dd0ba2fab81ef66906f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b27156fe7ab4391b30a0b973577b79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:57:36.046125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:36.053879 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:36.065880 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999675013999877 future=<Future at 0x72e27c180680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:36.068506 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance destroyed successfully.
Jun 26 02:57:36.069492 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'numa_topology' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:36.406283 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:57:36.410227 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Successfully created port: 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:57:36.558620 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:36.572652 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:36.572863 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:36.909259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:57:36.962996 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Successfully updated port: 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:57:37.013502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:37.013502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing instance network info cache due to event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:57:37.013502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:37.013502 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:37.013502 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:57:37.082235 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3afdf4f2-d1cf-4b16-b3ac-76eff7b4e3c0 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.355s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:37.422049 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:37.464958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:37.515801 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:37.587175 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:57:37.744093 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:37.926509 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:57:37.927696 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:57:37.928072 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Creating image(s)
Jun 26 02:57:37.928605 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:37.928771 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:37.929218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:37.929505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "4e74d0ccae03588765826d5adea96cd1c0a58859" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:37.929869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "4e74d0ccae03588765826d5adea96cd1c0a58859" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:38.007629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:38.007984 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:38.008123 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:38.008226 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:38.008375 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:38.008686 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-cdbe105b-a79f-45ad-81cd-10229607ef3f req-f23ac3e6-3995-47f0-98ae-aedbd8c84183 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state stopped and task_state None.
Jun 26 02:57:38.246427 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-11e3106a-f52b-452c-86fa-5ccaebd7f598 req-d586fab0-a009-4377-98ed-e8ab3c0c3d86 service nova] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:38.246790 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:38.246950 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:57:38.349152 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0011240409999118128 future=<Future at 0x72e27c182510 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:38.349152 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:38.349278 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=12.71623009699988 future=<Future at 0x72e27c180680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:38.349683 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=12.71613568199973 future=<Future at 0x72e27c180680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:38.353125 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Emitting event <LifecycleEvent: 1782442643.3478212, d46927ca-f4f7-4df7-8ec7-206ebbb96d5e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:38.353125 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] VM Stopped (Lifecycle Event)
Jun 26 02:57:38.381849 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:38.532214 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:38.535570 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:38.535902 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.part --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:38.583999 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'flavor' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:38.636775 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:38.637153 np0000003683 nova-compute[98991]: DEBUG nova.virt.images [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] 22db2ce2-a67b-415e-986f-b8fb1e5ad721 was qcow2, converting to raw {{(pid=98991) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 26 02:57:38.638174 np0000003683 nova-compute[98991]: DEBUG nova.privsep.utils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98991) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 26 02:57:38.638486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.part /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.converted {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:38.809260 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.part /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.converted" returned: 0 in 0.170s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:38.814617 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.converted --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:38.836515 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:57:38.857342 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: d46927ca-f4f7-4df7-8ec7-206ebbb96d5e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:38.865059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:38.930964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859.converted --force-share --output=json" returned: 0 in 0.115s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:38.930964 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "4e74d0ccae03588765826d5adea96cd1c0a58859" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:38.930964 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:38.934009 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:38.936878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:39.007076 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:39.029218 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:39.029725 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "4e74d0ccae03588765826d5adea96cd1c0a58859" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:39.030306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "4e74d0ccae03588765826d5adea96cd1c0a58859" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:39.030815 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:39.034055 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:57:39.034551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:39.090941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:57:39.091086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:57:39.091363 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:57:39.091610 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'info_cache' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:39.126959 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:39.127424 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859,backing_fmt=raw /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:39.191436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859,backing_fmt=raw /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk 1073741824" returned: 0 in 0.064s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:39.191812 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "4e74d0ccae03588765826d5adea96cd1c0a58859" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:39.192179 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:39.223279 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:39.307097 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e74d0ccae03588765826d5adea96cd1c0a58859 --force-share --output=json" returned: 0 in 0.114s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:39.307600 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:57:39.307600 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:39.421076 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:39.421626 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Cannot resize image /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:57:39.421909 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:57:39.422511 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Ensure instance console log exists: /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:57:39.424787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:39.424787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:39.424787 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:39.595617 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,info_cache {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:39.727449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:39.727887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance network_info: |[{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:57:39.729743 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Start _get_guest_xml network_info=[{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:57:30Z,direct_url=<?>,disk_format='qcow2',id=22db2ce2-a67b-415e-986f-b8fb1e5ad721,min_disk=0,min_ram=0,name='tempest-scenario-img--83015733',owner='7b27156fe7ab4391b30a0b973577b79c',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:57:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': '22db2ce2-a67b-415e-986f-b8fb1e5ad721'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:57:39.733925 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:57:39.735408 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='22db2ce2-a67b-415e-986f-b8fb1e5ad721', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1721270623', uuid='92ff8d21-f526-4702-b4ad-8693a8fd455a'), owner=OwnerMeta(userid='5c6f720766e94dd0ba2fab81ef66906f', username='tempest-TestMinimumBasicScenario-325636508-project-member', projectid='7b27156fe7ab4391b30a0b973577b79c', projectname='tempest-TestMinimumBasicScenario-325636508'), image=ImageMeta(id='22db2ce2-a67b-415e-986f-b8fb1e5ad721', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442659.7349572) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:57:39.736783 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:57:39.737228 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:57:39.738326 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:57:39.738557 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:57:39.739797 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:57:39.740244 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:57:30Z,direct_url=<?>,disk_format='qcow2',id=22db2ce2-a67b-415e-986f-b8fb1e5ad721,min_disk=0,min_ram=0,name='tempest-scenario-img--83015733',owner='7b27156fe7ab4391b30a0b973577b79c',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:57:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:57:39.740472 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:57:39.740661 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:57:39.740843 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:57:39.740980 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:57:39.741128 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:57:39.741392 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:57:39.741625 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:57:39.741821 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:57:39.741929 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:57:39.742093 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:57:39.754864 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1721270623',display_name='tempest-TestMinimumBasicScenario-server-1721270623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-1721270623',id=72,image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuPPd6F5qnyx8tqI7g3bGak8B3a1e+yxOsHJ503adSv7aZ3beMGVFfEH1U53ZMDFhibVJUuhATiEyWFCfzPmGzeEcMTLqJ3LKH8qZzPg2+W7eH1RKGA3YH3CYbWWyJhA==',key_name='tempest-TestMinimumBasicScenario-1072256690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-mk365x2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:57:37Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=92ff8d21-f526-4702-b4ad-8693a8fd455a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:57:39.755135 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:39.755598 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:39.756110 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'pci_devices' on Instance uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:40.098356 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <uuid>92ff8d21-f526-4702-b4ad-8693a8fd455a</uuid>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <name>instance-00000048</name>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestMinimumBasicScenario-server-1721270623</nova:name>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:57:39</nova:creationTime>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:image uuid="22db2ce2-a67b-415e-986f-b8fb1e5ad721">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:properties/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:user uuid="5c6f720766e94dd0ba2fab81ef66906f">tempest-TestMinimumBasicScenario-325636508-project-member</nova:user>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:project uuid="7b27156fe7ab4391b30a0b973577b79c">tempest-TestMinimumBasicScenario-325636508</nova:project>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="22db2ce2-a67b-415e-986f-b8fb1e5ad721"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         <nova:port uuid="1f456c56-73b6-4dfd-8216-a19cad2b6307">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="serial">92ff8d21-f526-4702-b4ad-8693a8fd455a</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="uuid">92ff8d21-f526-4702-b4ad-8693a8fd455a</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.config"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8a:18:fc"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <target dev="tap1f456c56-73"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/console.log" append="off"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:57:40.258878 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Preparing to wait for external event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1721270623',display_name='tempest-TestMinimumBasicScenario-server-1721270623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-1721270623',id=72,image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuPPd6F5qnyx8tqI7g3bGak8B3a1e+yxOsHJ503adSv7aZ3beMGVFfEH1U53ZMDFhibVJUuhATiEyWFCfzPmGzeEcMTLqJ3LKH8qZzPg2+W7eH1RKGA3YH3CYbWWyJhA==',key_name='tempest-TestMinimumBasicScenario-1072256690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-mk365x2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:57:37Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=92ff8d21-f526-4702-b4ad-8693a8fd455a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:40.261556 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:40.261963 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:57:40.263380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.263684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:40.264051 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:57:40.267447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.267635 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d685335-b983-5996-8074-5004b043aed4', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:40.268532 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.269342 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:40.280716 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.282684 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.282837 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f456c56-73, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:40.283199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f456c56-73, col_values=(('qos', UUID('ce5187d3-1eb9-4054-a570-52e9235836bb')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:40.283356 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f456c56-73, col_values=(('external_ids', {'iface-id': '1f456c56-73b6-4dfd-8216-a19cad2b6307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:18:fc', 'vm-uuid': '92ff8d21-f526-4702-b4ad-8693a8fd455a'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:40.284239 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.286362 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:40.295377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:40.296386 np0000003683 nova-compute[98991]: INFO os_vif [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73')
Jun 26 02:57:40.437875 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:40.570909 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating instance_info_cache with network_info: [{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:57:40.874715 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:41.072968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-09e776d5-a0a4-4e7a-b736-2e82b3d4236e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:57:41.815644 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:41.815806 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:41.815961 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No VIF found with MAC fa:16:3e:8a:18:fc, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:41.816500 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Using config drive
Jun 26 02:57:42.087123 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance destroyed successfully.
Jun 26 02:57:42.087631 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'numa_topology' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:42.321912 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:57:42.427518 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:42.433003 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Creating config drive at /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.config
Jun 26 02:57:42.436953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9jjojdx0 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:42.497232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9jjojdx0" returned: 0 in 0.060s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:42.589802 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:42.590163 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:42.955734 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:42.981303 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:42.983217 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.073147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.089245 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.092526 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:43.093546 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:56:56Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:57:43.093953 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:43.094634 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:43.094920 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:57:43.097696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.097696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72817169-48, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:43.099447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:43.100194 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.100411 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75edf374-fa6a-42b9-901e-d6fe9a3b33ea) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:43.102106 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:43.105937 np0000003683 nova-compute[98991]: INFO os_vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48')
Jun 26 02:57:43.111910 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:57:43.112390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:43.112614 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:43.113422 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:43.113927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:57:43.114116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:57:43.139447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:43.139447 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:43.139447 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:43.139754 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:43.139754 np0000003683 nova-compute[98991]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:43.139754 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:43.139754 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '190')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:57:43.139868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '190')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:43.140641 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '189')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:43.141276 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e2a41a4860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:57:43.141472 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:57:43.141649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000866cc253 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:57:43.199899 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:43.251007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:43.288368 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.289901 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.291593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.308117 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:57:43.308278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:57:43.309065 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:57:43.309735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:43.324134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:57:43.324428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:57:43.336382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.362505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260]
Jun 26 02:57:43.362505 np0000003683 nova-compute[98991]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:43.362505 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.373680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.383965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.408695 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260]
Jun 26 02:57:43.408695 np0000003683 nova-compute[98991]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:43.408695 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.420553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:43.420553 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:43.420709 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (308ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:43.420854 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:57:43.425916 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start _get_guest_xml network_info=[{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1f6ba87-0eb8-49bb-90b1-9ff1af8f257c', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '09e776d5-a0a4-4e7a-b736-2e82b3d4236e', 'attached_at': '', 'detached_at': '', 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'serial': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:57:43.428729 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:57:43.429795 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1712919056', uuid='09e776d5-a0a4-4e7a-b736-2e82b3d4236e'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442663.4294415) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:57:43.431446 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:57:43.431768 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:57:43.432968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:57:43.433133 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:57:43.434009 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:57:43.434270 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:57:43.434396 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:57:43.434493 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:57:43.434620 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:57:43.434699 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:57:43.434780 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:57:43.434940 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:57:43.435150 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:57:43.435327 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:57:43.435380 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:57:43.435516 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:57:43.435644 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:43.682021 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442663.6816294, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:43.682336 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Started (Lifecycle Event)
Jun 26 02:57:43.938419 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:43.949324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:44.041850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:44.042408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:44.042751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:44.043395 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:44.043888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:57:44.044374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:44.044578 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:44.044955 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:44.045310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:57:44.058244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:44.059004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:44.059489 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:44.059707 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:44.060124 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:44.060345 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:44.070865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:44.070865 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:44.076584 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:44.076584 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe] added
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:44.082829 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:44.083119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:44.083298 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:44.083496 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe] added
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:44.090452 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:44.090984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:44.090984 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:44.090984 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:44.185643 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:44.191131 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442664.1907325, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:44.191330 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Paused (Lifecycle Event)
Jun 26 02:57:44.285762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:44.286196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:44.631130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-388f168c-f6f6-4060-8600-41fdb8fe1960 req-1ef65a5c-7aa6-4808-a802-5c9965cd6648 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:44.631662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-388f168c-f6f6-4060-8600-41fdb8fe1960 req-1ef65a5c-7aa6-4808-a802-5c9965cd6648 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:44.631870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-388f168c-f6f6-4060-8600-41fdb8fe1960 req-1ef65a5c-7aa6-4808-a802-5c9965cd6648 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:44.632546 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-388f168c-f6f6-4060-8600-41fdb8fe1960 req-1ef65a5c-7aa6-4808-a802-5c9965cd6648 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:44.632546 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-388f168c-f6f6-4060-8600-41fdb8fe1960 req-1ef65a5c-7aa6-4808-a802-5c9965cd6648 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Processing event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:57:44.632875 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:57:44.635946 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:57:44.637915 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance spawned successfully.
Jun 26 02:57:44.638198 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:57:44.695309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:44.698027 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442664.6977499, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:44.698185 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Resumed (Lifecycle Event)
Jun 26 02:57:44.789874 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:45.084034 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:45.091337 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:45.097959 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:45.104414 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.111035 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.116085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.122080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:57:45.122080 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:45.122333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:57:45.122333 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:45.122406 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:57:45.122406 np0000003683 nova-compute[98991]: 
Jun 26 02:57:45.131221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:57:45.131221 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:45.131333 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 02:57:45.131333 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:45.131431 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 02:57:45.131431 np0000003683 nova-compute[98991]: 
Jun 26 02:57:45.145324 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.145502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.145834 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.146368 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.146705 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.146942 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:57:45.155906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260]
Jun 26 02:57:45.155906 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:45.155906 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.168785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.180952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260]
Jun 26 02:57:45.180952 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:45.180952 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.186636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.186636 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.186636 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:45.186773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.186773 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.186773 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:45.190500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:45.190500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:45.190500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('7', '-', '-', 0) found on session 191 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:45.190500 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:45.193846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:45.201204 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:45.204774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 191 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:45.204774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:45.204774 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:45.206846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.206846 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.206846 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:45.207079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.207079 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:45.207079 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:45.207341 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:45.207547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:45.208020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('8', '-', '-', 0) found on session 192 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:45.208135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:45.222896 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 192 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:45.223520 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:45.651462 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Took 7.72 seconds to spawn the instance on the hypervisor.
Jun 26 02:57:45.651704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:45.706910 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:57:45.803354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:46.060230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:57:46.160384 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Took 13.05 seconds to build instance.
Jun 26 02:57:46.661782 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.556s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:46.691254 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:46.691415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:46.691576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:46.691692 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:46.691800 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:46.691930 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-273d22f6-92c2-48a8-8aae-d81a3de00018 req-ed67adaa-fc58-4b09-a8b4-1ee3c1a80a0b service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received unexpected event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with vm_state active and task_state None.
Jun 26 02:57:46.850237 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:46.850487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:46.850775 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attaching volume e9f59d53-3ff1-43bf-b2f8-60afa442025e to /dev/vdb
Jun 26 02:57:46.887176 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:46.897691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:57:46.917539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:46.961508 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:57:46.961508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:57:46.969358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:57:46.970433 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe32:ed4f', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:57:46.970851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:57:46.970851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:57:46.970934 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:46.971146 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating existing volume attachment record: a6f819f6-720d-4912-a8eb-1126b177783c {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:57:47.077348 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000866cc253 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:57:47.077720 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:47.077917 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000866cc253', 'path': '/dev/dm-0', 'multipath_id': '330000000866cc253'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:47.078116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000866cc253', 'path': '/dev/dm-0', 'multipath_id': '330000000866cc253'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:57:47.430208 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:47.520065 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:57:47.520458 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:47.520593 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:47.586613 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:56:56Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:57:47.586859 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:47.587604 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:47.588415 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:48.091360 np0000003683 nova-compute[98991]: DEBUG nova.objects.base [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Object Instance<09e776d5-a0a4-4e7a-b736-2e82b3d4236e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98991) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <uuid>09e776d5-a0a4-4e7a-b736-2e82b3d4236e</uuid>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <name>instance-00000045</name>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1712919056</nova:name>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:57:43</nova:creationTime>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         <nova:port uuid="72817169-4801-4bfa-82b6-247f0334c477">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="serial">09e776d5-a0a4-4e7a-b736-2e82b3d4236e</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="uuid">09e776d5-a0a4-4e7a-b736-2e82b3d4236e</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/disk.config"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <alias name="ua-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <serial>9ac36c3f-4110-4fc3-94ab-ccc825ff54fe</serial>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:18:af:4d"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <target dev="tap72817169-48"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e/console.log" append="off"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:57:48.092439 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:57:48.094559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:57:48.094559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:56:56Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:57:48.094559 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:48.094559 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:48.094776 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:57:48.094872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.095095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:48.095300 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:57:48.095852 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.096037 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ca9bffd-ff11-5f63-aae3-b64d1acab3b9', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:48.104196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.105101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:48.105101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.106694 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.106848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72817169-48, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:48.107184 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72817169-48, col_values=(('qos', UUID('d30221a5-d732-411c-afe7-317afc967d08')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:48.107335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72817169-48, col_values=(('external_ids', {'iface-id': '72817169-4801-4bfa-82b6-247f0334c477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:af:4d', 'vm-uuid': '09e776d5-a0a4-4e7a-b736-2e82b3d4236e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:48.108407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.109094 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:48.114381 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.115225 np0000003683 nova-compute[98991]: INFO os_vif [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48')
Jun 26 02:57:48.545665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.572108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.575426 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.677026 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.779130 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:48.779353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:48.779534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:48.779658 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:48.779827 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:48.782044 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-71ab0e8f-a325-457e-982c-430bc53de30a req-4a0b6540-3f71-409e-976f-bdc198b9f876 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state stopped and task_state powering-on.
Jun 26 02:57:48.886797 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:48.887522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:48.925221 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.931114 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:48.949084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:49.391898 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:49.452675 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 09e776d5-a0a4-4e7a-b736-2e82b3d4236e due to new event <LifecycleEvent: 1782442669.4521885, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:57:49.452952 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442669.4521885, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:49.453742 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Resumed (Lifecycle Event)
Jun 26 02:57:49.455745 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance event wait completed in 0 seconds for  {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:57:49.458980 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance rebooted successfully.
Jun 26 02:57:49.957465 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:49.959933 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:50.115126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:50.115494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:50.179853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.659s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:50.180932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:57:50.197496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:50.198049 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:50.198335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:50.198538 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:50.198875 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:50.199074 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:50.213392 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:50.213392 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:50.213972 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:50.213972 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e] added
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:50.226504 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e] added
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:50.230839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:50.231318 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:50.231318 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:50.396903 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:50.463822 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 26 02:57:50.463968 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442670.46374, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:57:50.464051 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Started (Lifecycle Event)
Jun 26 02:57:50.618497 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:50.839390 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:50.840346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:50.840540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:50.840672 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:50.840829 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:50.841041 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d9ce1107-de30-4f34-9ee1-b1d4eb6b9b98 req-6e090239-2d69-4ee2-9fec-87cda575ec24 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received unexpected event network-vif-plugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with vm_state stopped and task_state powering-on.
Jun 26 02:57:50.968698 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:50.974585 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:50.974721 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:50.974836 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:18:af:4d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:50.975173 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-413cb41e-ae44-4745-897a-3139aa2554fc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:57:50.976802 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:57:51.065859 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003217710000171792 future=<Future at 0x72e27c180680 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:51.065975 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:51.226935 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:51.231498 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:51.240798 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:51.246046 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.254502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.261904 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.271901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.271901 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.271901 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.271901 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.271901 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:51.272225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.272225 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.272225 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.272225 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.272225 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:51.280609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.280609 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.280609 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.280609 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.280609 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:51.281003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.281003 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.281003 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.281003 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.281003 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:51.310122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.40.100,3260]
Jun 26 02:57:51.310122 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:51.310122 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.317538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.50.100,3260]
Jun 26 02:57:51.317538 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:51.317538 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.327770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.334358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.347063 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.347331 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:51.347544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:51.347544 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:51.348298 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('11', '-', '-', 0) found on session 195 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:51.348398 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.354070 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:51.354278 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:51.354608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:51.354608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:51.355275 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('12', '-', '-', 0) found on session 196 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:51.355367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:51.364846 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 195 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:51.365146 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:51.372952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 196 and hctl ['12', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:51.476503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:51.476503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:51.476503 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Attaching volume 3f584118-7789-4ceb-b29f-dcdd42b74f52 to /dev/vdb
Jun 26 02:57:51.479345 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 26 02:57:51.525075 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:51.539370 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:57:51.564543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:51.616760 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-601bfcf5-df65-45d2-8e78-d270918d59bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Get console output
Jun 26 02:57:51.623695 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:51.624876 np0000003683 nova-compute[98991]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jun 26 02:57:51.626492 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:57:51.627466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:57:51.636094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:57:51.638041 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe32:ed4f', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b', 'fe80::fc16:3eff:fe18:af4d', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:57:51.638255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:57:51.638418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:57:51.638732 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:51.638959 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating existing volume attachment record: 15eece1e-ef17-47ce-9103-84d0b13e62c6 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:57:52.187639 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:57:52.188619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:52.188619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:52.369699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 196 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:52.369870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:52.430210 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:52.733696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:52.733812 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:52.733928 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Attaching volume 267cf20b-2a9c-4a63-a97a-c3d5eced6b80 to /dev/vdb
Jun 26 02:57:52.770063 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:52.780501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:57:52.800067 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:52.844417 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:57:52.844738 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:57:52.853228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:57:52.854315 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe32:ed4f', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b', 'fe80::fc16:3eff:fe18:af4d', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:57:52.854435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:57:52.854556 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:57:52.854756 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:52.854980 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updating existing volume attachment record: 27de0b49-d3ab-49ef-bd4b-2a66613723e3 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:57:53.127593 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:53.216410 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found WWN 330000000bf03a184 for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:57:53.216940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:53.217159 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== connect_volume: return (5696ms) {'type': 'block', 'scsi_wwn': '330000000bf03a184', 'path': '/dev/dm-4', 'multipath_id': '330000000bf03a184'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:53.217317 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf03a184', 'path': '/dev/dm-4', 'multipath_id': '330000000bf03a184'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:57:53.218079 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.029s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:53.218526 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:57:53.227188 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:53.234638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:53.235382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:53.235732 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:53.236327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:53.239681 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:53.239885 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:53.248710 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:53.248710 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:53.258168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:53.258168 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52] added
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:53.262154 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:53.262368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:53.262491 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:53.262661 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52] added
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:53.269696 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:53.269920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:53.270051 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:53.270851 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:53.401981 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:57:53.402399 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:53.402634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:53.736734 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to attach volume e9f59d53-3ff1-43bf-b2f8-60afa442025e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:   <alias name="ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e"/>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:   <serial>e9f59d53-3ff1-43bf-b2f8-60afa442025e</serial>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:57:53.738451 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:57:53.786008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:53.786195 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:53.786390 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:53.786542 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:53.786664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:53.788790 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Terminating instance
Jun 26 02:57:54.263252 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:54.271375 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:54.278213 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:54.286058 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.291850 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.294404 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:57:54.301599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.311939 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.312384 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:54.318805 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.321443 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.321659 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:54.321996 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:54.341903 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:54.344411 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:54.344591 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:54.344945 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:57:54.352775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.40.100,3260]
Jun 26 02:57:54.352775 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:54.352775 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.364496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.374376 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:54.380960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.50.100,3260]
Jun 26 02:57:54.380960 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:54.380960 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.386672 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.387040 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:54.387283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:54.387283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:54.388132 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('13', '-', '-', 0) found on session 197 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:54.388235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:54.395732 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:54.402663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 197 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:54.402663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.415592 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:54.415886 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:54.416055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:54.416764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:54.418353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] HCTL ('14', '-', '-', 0) found on session 198 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:54.418353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:54.435309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Searching for a device in session 198 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:54.435309 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:54.524436 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:54.524436 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:54.524848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:54.524848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:54.525145 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:54.525444 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-2fa48343-2b00-4b66-a30f-e8101e2dd478 req-a1d9fc73-3b36-4a41-baa1-c83a747fc5e3 service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:57:54.637185 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99967223900012 future=<Future at 0x72e29c3d3110 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:54.640459 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998929718 future=<Future at 0x72e29c3d3110 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:54.640459 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998313901000074 future=<Future at 0x72e29c3d3110 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:57:54.641352 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Instance destroyed successfully.
Jun 26 02:57:54.641947 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 09e776d5-a0a4-4e7a-b736-2e82b3d4236e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:55.147938 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712919056',display_name='tempest-TestVolumeBootPattern-server-1712919056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1712919056',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlTRkpQ1av8/McgxPt2exR4bRmIjJOCv5jHXX1I9UHJDR3efDPABUd//UjObvORbWrEEKxhncQf7O89+pRBMHjE1lTFmY787sO83HLzF9+w1qjbfObDwxTMmcBFKVn6UA==',key_name='tempest-keypair-783527693',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:56:56Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-jsnmx7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=09e776d5-a0a4-4e7a-b736-2e82b3d4236e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:57:55.148200 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "72817169-4801-4bfa-82b6-247f0334c477", "address": "fa:16:3e:18:af:4d", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72817169-48", "ovs_interfaceid": "72817169-4801-4bfa-82b6-247f0334c477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:57:55.148836 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:57:55.149096 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:57:55.150361 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.150691 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72817169-48, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:55.151677 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.152409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:55.152557 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.153229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.153369 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d30221a5-d732-411c-afe7-317afc967d08) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:57:55.153766 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.154175 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:57:55.154502 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:55.156365 np0000003683 nova-compute[98991]: INFO os_vif [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:af:4d,bridge_name='br-int',has_traffic_filtering=True,id=72817169-4801-4bfa-82b6-247f0334c477,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72817169-48')
Jun 26 02:57:55.158080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:57:55.158456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:57:55.158667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:55.237469 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:57:55.391160 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:55.391560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:55.391560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:55.391560 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No VIF found with MAC fa:16:3e:1f:2e:0d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:56.253122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found WWN 330000000458801e4 for multipath device dm-5 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:57:56.253466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:56.253662 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== connect_volume: return (4064ms) {'type': 'block', 'scsi_wwn': '330000000458801e4', 'path': '/dev/dm-5', 'multipath_id': '330000000458801e4'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:56.253786 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000458801e4', 'path': '/dev/dm-5', 'multipath_id': '330000000458801e4'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:57:56.254139 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.852s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:56.254403 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:57:56.258079 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:56.268239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:56.269144 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:57:56.269438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:56.269731 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:56.270233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:56.270432 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:56.281324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:56.281324 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:56.288175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:57:56.288175 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80] added
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:56.295595 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:56.295859 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:56.295859 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:56.296006 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80] added
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:57:56.299897 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:56.300176 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:57:56.300254 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:57:56.300399 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:57:56.343839 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:56.343979 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:57:56.344256 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:57:56.584925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:57:56.585432 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] Acquiring lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:56.585705 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:56.585848 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:56.586031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] No waiting events found dispatching network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:57:56.586207 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-40651f73-c27b-4664-aea6-bacfd66b6880 req-b466fdb4-abb1-4f94-b095-74373b8915fb service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-unplugged-72817169-4801-4bfa-82b6-247f0334c477 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:57:56.760775 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Attempting to attach volume 3f584118-7789-4ceb-b29f-dcdd42b74f52 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:   <alias name="ua-3f584118-7789-4ceb-b29f-dcdd42b74f52"/>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:   <serial>3f584118-7789-4ceb-b29f-dcdd42b74f52</serial>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:57:56.762241 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:57:56.937296 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4d61ad2a-ce44-44dc-946e-85662e78a829 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.087s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:57.296501 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:57:57.300705 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:57.311838 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:57:57.317430 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.325718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.336052 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.343717 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.344833 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.345145 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.355804 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.356136 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:57.392295 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.40.100,3260]
Jun 26 02:57:57.392295 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:57.392295 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.403238 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.50.100,3260]
Jun 26 02:57:57.403238 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:57.403238 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.403768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.419854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.425714 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.426051 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:57.426294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:57.426433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:57.427600 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('15', '-', '-', 0) found on session 199 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:57.427712 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:57.433235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.439256 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:57.439631 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:57.439958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:57.439958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:57:57.440978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] HCTL ('16', '-', '-', 0) found on session 200 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:57:57.441111 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:57:57.447796 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 199 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:57.447796 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:57.456470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 200 and hctl ['16', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:57.854153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:57.854615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:57.854615 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:57:57.854682 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:57:58.395752 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:58.395882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:58.395882 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:57:58.396010 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] No VIF found with MAC fa:16:3e:8a:18:fc, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:57:58.456166 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Searching for a device in session 200 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:57:58.456226 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:57:58.880649 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:57:58.882874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:58.993380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:58.994013 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.088931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.089373 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:57:59.093648 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.185907 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.186466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.277412 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.282352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.295558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found WWN 330000000316f25d1 for multipath device dm-6 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:57:59.296927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:59.297691 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== connect_volume: return (5894ms) {'type': 'block', 'scsi_wwn': '330000000316f25d1', 'path': '/dev/dm-6', 'multipath_id': '330000000316f25d1'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:59.298071 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000316f25d1', 'path': '/dev/dm-6', 'multipath_id': '330000000316f25d1'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:57:59.299937 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.141s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:57:59.301716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:57:59.302222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:57:59.311419 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:59.338815 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:57:59.339161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '199'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '200')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:57:59.339518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '191')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:59.340274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe', '192')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:57:59.341109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3e6de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:57:59.341292 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:57:59.341516 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000866cc253 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:57:59.372713 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.373202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.401749 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:59.448025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:57:59.464255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.464612 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:57:59.469138 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:57:59.470596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:57:59.514223 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:57:59.514505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:57:59.516687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:57:59.524683 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:57:59.525201 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50726MB free_disk=71.69475936889648GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:57:59.525433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:57:59.525760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:57:59.528764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:57:59.528971 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:57:59.540452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.577940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260]
Jun 26 02:57:59.577940 np0000003683 nova-compute[98991]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.40.100,3260] successful.
Jun 26 02:57:59.577940 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.596134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.607893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.654690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260]
Jun 26 02:57:59.654690 np0000003683 nova-compute[98991]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-9ac36c3f-4110-4fc3-94ab-ccc825ff54fe, portal: 192.168.50.100,3260] successful.
Jun 26 02:57:59.654690 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (4513ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Deleting instance files /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e_del
Jun 26 02:57:59.675504 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Deletion of /opt/stack/data/nova/instances/09e776d5-a0a4-4e7a-b736-2e82b3d4236e_del complete
Jun 26 02:57:59.822691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Attempting to attach volume 267cf20b-2a9c-4a63-a97a-c3d5eced6b80 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <alias name="ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80"/>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-6"/>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <serial>267cf20b-2a9c-4a63-a97a-c3d5eced6b80</serial>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:57:59.827374 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:57:59.965633 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4729bf81-84cf-4568-a452-4b18b008b1a1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.491s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:00.155833 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:00.183368 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Took 5.89 seconds to destroy the instance on the hypervisor.
Jun 26 02:58:00.183838 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:58:00.184193 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:58:00.184316 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:58:00.184617 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:00.274958 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:00.590417 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 09e776d5-a0a4-4e7a-b736-2e82b3d4236e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:58:00.591097 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:58:00.591097 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 21df308b-5507-4700-990f-8ec3d8a12587 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:58:00.591097 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 92ff8d21-f526-4702-b4ad-8693a8fd455a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:58:00.591097 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:58:00.591097 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:57:59 up 44 min,  2 users,  load average: 3.47, 5.28, 4.84\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_deleting': '1', 'num_os_type_None': '4', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'io_workload': '0', 'num_task_None': '3', 'num_proj_884d962a595245afbe319c15ac2ccc1f': '1', 'num_proj_87599dd62cac4c0d9bfad984dc67bf67': '1', 'num_proj_7b27156fe7ab4391b30a0b973577b79c': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:58:00.759260 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9e9a0c69-4423-474f-86c1-6e5d4937d434 req-67b05ec7-9e37-4ccc-86cc-431d12330f7f service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Received event network-vif-deleted-72817169-4801-4bfa-82b6-247f0334c477 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:00.759713 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-9e9a0c69-4423-474f-86c1-6e5d4937d434 req-67b05ec7-9e37-4ccc-86cc-431d12330f7f service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Neutron deleted interface 72817169-4801-4bfa-82b6-247f0334c477; detaching it from the instance and deleting it from the info cache
Jun 26 02:58:00.762094 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9e9a0c69-4423-474f-86c1-6e5d4937d434 req-67b05ec7-9e37-4ccc-86cc-431d12330f7f service nova] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Detach interface failed, port_id=72817169-4801-4bfa-82b6-247f0334c477, reason: Instance 09e776d5-a0a4-4e7a-b736-2e82b3d4236e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:58:00.823510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:00.824168 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:01.206121 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:01.325051 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:01.325051 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing instance network info cache due to event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:01.325051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:01.325051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:01.325198 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:01.332212 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:01.481078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:01.483502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:01.483502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:01.483502 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] No VIF found with MAC fa:16:3e:32:ed:4f, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:01.709629 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Took 1.53 seconds to deallocate network for instance.
Jun 26 02:58:01.840550 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:01.842261 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:58:01.842846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.317s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:01.843376 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:02.192460 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:02.268493 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 02:58:02.349889 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updated VIF entry in instance network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:58:02.350238 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:02.434870 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:02.773824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:02.773992 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:02.852319 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05c86a6b-3889-470b-a3c9-ace22d66f543 req-b8d4b17d-ce7e-4b09-911a-9f0cad6cc541 service nova] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:02.864707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:02.865198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:02.953097 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:02.953214 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing instance network info cache due to event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:02.953666 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:02.953666 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:02.953666 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:03.047616 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c42ee6cd-1b05-4ad6-866b-0c71fd309267 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.314s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:03.064785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:03.065020 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:03.368656 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:58:03.459344 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:03.569497 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:03.725794 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:03.727372 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:03.727572 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:03.841249 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updated VIF entry in instance network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:58:03.841627 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:03.922325 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:04.075419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:04.076750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.154s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:04.080138 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:58:04.080271 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Claim successful on node np0000003683
Jun 26 02:58:04.123210 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 09e776d5-a0a4-4e7a-b736-2e82b3d4236e
Jun 26 02:58:04.229712 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Detaching volume 267cf20b-2a9c-4a63-a97a-c3d5eced6b80
Jun 26 02:58:04.263211 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Attempting to driver detach volume 267cf20b-2a9c-4a63-a97a-c3d5eced6b80 from mountpoint /dev/vdb
Jun 26 02:58:04.267152 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:04.268147 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Found disk vdb by alias ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:04.268253 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Attempting to detach device vdb from instance 21df308b-5507-4700-990f-8ec3d8a12587 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <alias name="ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80"/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-6"/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <serial>267cf20b-2a9c-4a63-a97a-c3d5eced6b80</serial>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:04.268445 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:04.273782 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance 21df308b-5507-4700-990f-8ec3d8a12587 from the persistent domain config.
Jun 26 02:58:04.273901 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] (1/8): Attempting to detach device vdb with device alias ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 from instance 21df308b-5507-4700-990f-8ec3d8a12587 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <alias name="ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80"/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-6"/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <serial>267cf20b-2a9c-4a63-a97a-c3d5eced6b80</serial>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <shareable/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:04.274131 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:04.343514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6792e345-eee9-45fb-a19f-a199d260c36e req-d8d3c29a-9c71-447c-a53e-a2e56f7bc44f service nova] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:04.343880 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:04.344165 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:04.344363 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:04.344535 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:04.344726 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:04.344852 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 26 02:58:04.747123 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442684.7467527, 21df308b-5507-4700-990f-8ec3d8a12587 => ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:58:04.748205 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 for instance 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:58:04.750316 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully detached device vdb from instance 21df308b-5507-4700-990f-8ec3d8a12587 from the live domain config.
Jun 26 02:58:04.776102 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:58:04.776382 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:04.776538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:04.776847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:04.777181 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:58:04.777313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:58:04.805256 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsi session list stdout=tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80 (non-flash)
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:04.805531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '199'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '200')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:58:04.805721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '199')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:04.806599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80', '200')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:04.807413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4edda0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'): ({'sdk'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:58:04.807622 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Removing multipathed devices sdj, sdk {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:58:04.807988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Flush multipath device 330000000316f25d1 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:58:04.837858 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:04.846759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] There are 0 instances to clean {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 26 02:58:04.847144 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:04.893290 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:04.931830 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:58:04.932053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:58:04.932923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:58:04.944451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:58:04.944656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:58:04.955884 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:04.984632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.40.100,3260]
Jun 26 02:58:04.984632 np0000003683 nova-compute[98991]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:04.984632 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:05.000872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:05.013389 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:05.043723 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.50.100,3260]
Jun 26 02:58:05.043723 np0000003683 nova-compute[98991]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-267cf20b-2a9c-4a63-a97a-c3d5eced6b80, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:05.043723 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:05.058527 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:05.058739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:05.058893 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] <== disconnect_volume: return (282ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:05.059109 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:58:05.130573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3357959a-6f73-4644-921a-a8446fb26f1d tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "09e776d5-a0a4-4e7a-b736-2e82b3d4236e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.344s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:05.157254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:05.315765 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:05.316054 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:05.607831 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'flavor' on Instance uuid 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:05.818399 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:05.842873 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:05.843212 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:06.325140 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.249s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:06.325632 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:58:06.343739 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:06.344005 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:06.613819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5879470c-d329-4e4c-94ab-d1f339585635 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.886s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:06.830806 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:58:06.831417 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:58:06.831952 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:06.832096 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:06.899542 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '209bf2f2739a4be69e4ecbddb9411821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc75731d341143958b1030ac806f2343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:58:07.221504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:07.221504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:07.320245 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Successfully created port: 0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:58:07.333965 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:58:07.436735 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:07.724004 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Detaching volume e9f59d53-3ff1-43bf-b2f8-60afa442025e
Jun 26 02:58:07.739424 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:07.770743 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to driver detach volume e9f59d53-3ff1-43bf-b2f8-60afa442025e from mountpoint /dev/vdb
Jun 26 02:58:07.775655 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:07.777012 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:07.777166 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Attempting to detach device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <alias name="ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e"/>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <serial>e9f59d53-3ff1-43bf-b2f8-60afa442025e</serial>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:07.777426 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:07.784189 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config.
Jun 26 02:58:07.784397 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] (1/8): Attempting to detach device vdb with device alias ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <alias name="ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e"/>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-4"/>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <serial>e9f59d53-3ff1-43bf-b2f8-60afa442025e</serial>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:07.784811 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:07.836675 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:58:07.857819 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Successfully updated port: 0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:58:07.918766 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-changed-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:07.919205 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Refreshing instance network info cache due to event network-changed-0f968dc3-43a3-476c-ad97-a8144fbc7281. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:07.919353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] Acquiring lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:07.919437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] Acquired lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:07.919569 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Refreshing network info cache for port 0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:08.089411 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:08.089576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:08.089749 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:08.089868 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:08.089999 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:08.091702 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Terminating instance
Jun 26 02:58:08.294642 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442688.2943003, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:58:08.295436 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e9f59d53-3ff1-43bf-b2f8-60afa442025e for instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:58:08.297733 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config.
Jun 26 02:58:08.298665 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:58:08.298902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:08.299031 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:08.299321 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:08.299591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9f59d53-3ff1-43bf-b2f8-60afa442025e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:58:08.299708 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:58:08.323390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:08.323390 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:08.323390 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:08.323390 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:08.323390 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e (non-flash)
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:08.323687 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:58:08.323829 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '195')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:08.324638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e', '196')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:08.325281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c31ad40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:58:08.325467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:58:08.325722 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flush multipath device 330000000bf03a184 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:58:08.344612 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:08.360192 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:08.362218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:08.411898 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:08.421421 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:08.446826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:58:08.446958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:58:08.447633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:58:08.459235 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:58:08.459413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:58:08.470212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.482338 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:08.500494 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.40.100,3260]
Jun 26 02:58:08.500494 np0000003683 nova-compute[98991]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:08.500494 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.512721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.523135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.549651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.50.100,3260]
Jun 26 02:58:08.549651 np0000003683 nova-compute[98991]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-e9f59d53-3ff1-43bf-b2f8-60afa442025e, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:08.549651 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.562588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:08.562762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:08.562861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== disconnect_volume: return (264ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:08.562973 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:58:08.595995 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:58:08.606507 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:08.614920 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.616940 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.631732 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.634615 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.655058 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.752822 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:08.753299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:08.753444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:08.753566 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:08.753674 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] No waiting events found dispatching network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:08.753775 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0ae276ef-d6b7-49bc-af5d-d1a5603154f9 req-4701e2fa-7e4a-4818-844e-79bfafa86c4f service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:58:08.844856 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:58:08.846216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:58:08.846451 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Creating image(s)
Jun 26 02:58:08.846983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:08.847139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:08.847503 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:08.848146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:08.848712 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:58:08.851549 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:58:08.852933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:08.891267 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.898792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:08.928138 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99951451600009 future=<Future at 0x72e27c4a94c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:08.933162 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Instance destroyed successfully.
Jun 26 02:58:08.933742 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lazy-loading 'resources' on Instance uuid 21df308b-5507-4700-990f-8ec3d8a12587 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:08.953306 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:08.953705 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:08.954160 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:08.954609 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:58:08.957195 np0000003683 nova-compute[98991]: DEBUG oslo_utils.imageutils.format_inspector [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98991) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 26 02:58:08.957488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:09.054918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:09.055392 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk 1073741824 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:09.110606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f2fd32e8-38bf-424d-b95f-f1043af19e59 req-8b06b659-5fa8-4ca6-8bf0-5a0543984992 service nova] Releasing lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:09.110606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquired lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:09.110606 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:58:09.122310 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7,backing_fmt=raw /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk 1073741824" returned: 0 in 0.067s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:09.123210 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "f91b36b16e8c0ae4c0ade05a67488d71e691a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:09.123323 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:09.141533 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:09.218807 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91b36b16e8c0ae4c0ade05a67488d71e691a5d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:09.219254 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk. size=1073741824 {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 26 02:58:09.219546 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:09.315804 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:09.316243 np0000003683 nova-compute[98991]: DEBUG nova.virt.disk.api [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Cannot resize image /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk to a smaller size. {{(pid=98991) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 26 02:58:09.316650 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Created local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 26 02:58:09.316807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Ensure instance console log exists: /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:58:09.317086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:09.317290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:09.317433 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:09.437575 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1202906500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-volumemultiattachtests-server-1202906500',id=71,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWzIJx8doEsyE08okB1RHeYJHBXcmxxPCibOBOAk15kefo2AkyjY/oSJcgcFbffAjb79RwC7A/ax+gVa4ydELnnSffCmMc6Hr6P7Gc2jdU45rDm4gNIK6zCULS7mFJ9rw==',key_name='tempest-keypair-1855948039',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:57:09Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87599dd62cac4c0d9bfad984dc67bf67',ramdisk_id='',reservation_id='r-8lhqbnxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-190007800',owner_user_name='tempest-VolumeMultiattachTests-190007800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145815cb362e40ad95db2c64431821bc',uuid=21df308b-5507-4700-990f-8ec3d8a12587,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:58:09.437822 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converting VIF {"id": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "address": "fa:16:3e:32:ed:4f", "network": {"id": "e7c706df-bf83-47ff-8ad1-a64938812aa4", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-539812469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "87599dd62cac4c0d9bfad984dc67bf67", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b9c4b6d-71", "ovs_interfaceid": "4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:09.438574 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:09.438841 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:58:09.440606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:09.441093 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b9c4b6d-71, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:09.442652 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:09.444059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:09.444799 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:09.445009 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b923d62-7ba3-4443-a623-365d4cd4a88e) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:09.445508 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:09.446088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:09.448087 np0000003683 nova-compute[98991]: INFO os_vif [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:ed:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4,network=Network(e7c706df-bf83-47ff-8ad1-a64938812aa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b9c4b6d-71')
Jun 26 02:58:09.448404 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Deleting instance files /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587_del
Jun 26 02:58:09.449304 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Deletion of /opt/stack/data/nova/instances/21df308b-5507-4700-990f-8ec3d8a12587_del complete
Jun 26 02:58:09.636719 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004783730000781361 future=<Future at 0x72e29c3d3110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:09.637317 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Emitting event <LifecycleEvent: 1782442674.6361067, 09e776d5-a0a4-4e7a-b736-2e82b3d4236e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:09.637577 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:09.637800 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] VM Stopped (Lifecycle Event)
Jun 26 02:58:09.639111 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.288413381999817 future=<Future at 0x72e27c4a94c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:09.639243 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.288269865000075 future=<Future at 0x72e27c4a94c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:09.690067 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:09.847758 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:09.961654 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 26 02:58:09.962372 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:58:09.962869 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:58:09.963016 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:58:09.963268 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:09.987879 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updating instance_info_cache with network_info: [{"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:10.026146 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:10.140759 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 09e776d5-a0a4-4e7a-b736-2e82b3d4236e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:10.150422 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-ede3c510-f919-41fe-a310-7d3ee952d8a8 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.929s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:10.404068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:10.404316 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:10.490304 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Releasing lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:10.490620 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance network_info: |[{"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:58:10.492526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Start _get_guest_xml network_info=[{"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'boot_index': 0, 'image_id': 'eb0918cd-17b7-4dc6-8a46-002286996c07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:58:10.495756 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:58:10.497120 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb0918cd-17b7-4dc6-8a46-002286996c07', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1575659100', uuid='93a2c213-03d0-4ecb-8d98-05705ea10619'), owner=OwnerMeta(userid='209bf2f2739a4be69e4ecbddb9411821', username='tempest-TestEncryptedCinderVolumes-1323610914-project-member', projectid='dc75731d341143958b1030ac806f2343', projectname='tempest-TestEncryptedCinderVolumes-1323610914'), image=ImageMeta(id='eb0918cd-17b7-4dc6-8a46-002286996c07', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442690.4967206) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:58:10.499586 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0b60d40-859f-4dbe-a7c6-fce848be241e req-d1b99b3b-de75-4310-bdec-b01d10f1517b service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-deleted-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:10.500172 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:58:10.500312 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-d0b60d40-859f-4dbe-a7c6-fce848be241e req-d1b99b3b-de75-4310-bdec-b01d10f1517b service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Neutron deleted interface 4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4; detaching it from the instance and deleting it from the info cache
Jun 26 02:58:10.500691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:58:10.501864 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d0b60d40-859f-4dbe-a7c6-fce848be241e req-d1b99b3b-de75-4310-bdec-b01d10f1517b service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Detach interface failed, port_id=4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4, reason: Instance 21df308b-5507-4700-990f-8ec3d8a12587 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:58:10.502621 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:58:10.502858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:58:10.503856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:58:10.504178 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T02:38:07Z,direct_url=<?>,disk_format='qcow2',id=eb0918cd-17b7-4dc6-8a46-002286996c07,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e7402a80596f489488cac8cab13bac60',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-26T02:38:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:58:10.504330 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:58:10.504422 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:58:10.504652 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:58:10.504776 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:58:10.504910 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:58:10.505136 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:58:10.505279 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:58:10.505424 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:58:10.505576 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:58:10.505729 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:58:10.517463 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1575659100',display_name='tempest-TestEncryptedCinderVolumes-server-1575659100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1575659100',id=73,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTAm5aGTCFgeEn6rfn0jybiJZD9JwcLQx8TvNcY06JikUKCzkpxbQh8mCMUG9sB9ZqIVo3SyhDxYW3+pCoPPVVoCjLDYOH0f8KHXbpqbELLoDAt/TXmKWX9vSP8+N0Lw==',key_name='tempest-keypair-990125776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-uhpu08nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=93a2c213-03d0-4ecb-8d98-05705ea10619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:58:10.517780 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:10.518257 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:10.518756 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'pci_devices' on Instance uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:10.807225 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:10.807662 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] Acquiring lock "21df308b-5507-4700-990f-8ec3d8a12587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:10.807983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:10.808269 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] Lock "21df308b-5507-4700-990f-8ec3d8a12587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:10.808568 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] No waiting events found dispatching network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:10.808805 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-05f51d19-7b8c-4a3f-b9ba-10e24aa47b94 req-2dae6ba1-d1e3-475e-814a-274124db80e1 service nova] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Received event network-vif-unplugged-4b9c4b6d-71c6-47e5-ae8f-9697e7cf62c4 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:58:10.906591 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:58:10.955536 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <uuid>93a2c213-03d0-4ecb-8d98-05705ea10619</uuid>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <name>instance-00000049</name>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1575659100</nova:name>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:58:10</nova:creationTime>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:image uuid="eb0918cd-17b7-4dc6-8a46-002286996c07">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:user uuid="209bf2f2739a4be69e4ecbddb9411821">tempest-TestEncryptedCinderVolumes-1323610914-project-member</nova:user>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:project uuid="dc75731d341143958b1030ac806f2343">tempest-TestEncryptedCinderVolumes-1323610914</nova:project>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid="eb0918cd-17b7-4dc6-8a46-002286996c07"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         <nova:port uuid="0f968dc3-43a3-476c-ad97-a8144fbc7281">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="serial">93a2c213-03d0-4ecb-8d98-05705ea10619</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="uuid">93a2c213-03d0-4ecb-8d98-05705ea10619</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <disk type="file" device="disk">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.config"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:2f:d2:c8"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <target dev="tap0f968dc3-43"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/console.log" append="off"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:58:11.021303 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Preparing to wait for external event network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1575659100',display_name='tempest-TestEncryptedCinderVolumes-server-1575659100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1575659100',id=73,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTAm5aGTCFgeEn6rfn0jybiJZD9JwcLQx8TvNcY06JikUKCzkpxbQh8mCMUG9sB9ZqIVo3SyhDxYW3+pCoPPVVoCjLDYOH0f8KHXbpqbELLoDAt/TXmKWX9vSP8+N0Lw==',key_name='tempest-keypair-990125776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-uhpu08nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=93a2c213-03d0-4ecb-8d98-05705ea10619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:58:11.023419 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:11.024464 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:11.024683 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:58:11.024907 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.025101 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:11.025272 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:58:11.025758 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.025885 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21427bc5-57f8-5c39-b646-380aeeca984e', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:11.026572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.027310 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:11.027688 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.029198 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.029363 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f968dc3-43, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:11.029741 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f968dc3-43, col_values=(('qos', UUID('7bc0a62f-d869-4a81-ad19-9be24cef2f51')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:11.029943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f968dc3-43, col_values=(('external_ids', {'iface-id': '0f968dc3-43a3-476c-ad97-a8144fbc7281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:d2:c8', 'vm-uuid': '93a2c213-03d0-4ecb-8d98-05705ea10619'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:11.030671 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.031784 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:11.036765 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:11.037287 np0000003683 nova-compute[98991]: INFO os_vif [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43')
Jun 26 02:58:11.455706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:11.456405 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Took 1.49 seconds to deallocate network for instance.
Jun 26 02:58:11.456722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:11.463202 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:58:11.463366 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Claim successful on node np0000003683
Jun 26 02:58:11.687997 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:11.688229 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:11.962409 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:12.191321 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:12.438359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:12.551791 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:12.551920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:12.552057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No VIF found with MAC fa:16:3e:2f:d2:c8, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:12.552435 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Using config drive
Jun 26 02:58:12.846735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:12.847109 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:12.848671 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:12.848815 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98991) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 26 02:58:13.057775 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:13.179944 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Creating config drive at /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.config
Jun 26 02:58:13.184682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfz79wwea {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:13.199174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:13.246348 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfz79wwea" returned: 0 in 0.061s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:13.351615 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:13.357404 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 16.35 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:13.633370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:13.657671 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:13.661610 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:13.712296 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:13.712503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:13.712736 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Rebooting instance
Jun 26 02:58:13.745507 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:13.828943 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b9161047-e463-4830-a0ac-5ea45e0faa6d req-a088b1af-4810-4963-bb9f-2b4182dc1d50 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:13.829180 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b9161047-e463-4830-a0ac-5ea45e0faa6d req-a088b1af-4810-4963-bb9f-2b4182dc1d50 service nova] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:13.829353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b9161047-e463-4830-a0ac-5ea45e0faa6d req-a088b1af-4810-4963-bb9f-2b4182dc1d50 service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:13.829487 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b9161047-e463-4830-a0ac-5ea45e0faa6d req-a088b1af-4810-4963-bb9f-2b4182dc1d50 service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:13.829661 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b9161047-e463-4830-a0ac-5ea45e0faa6d req-a088b1af-4810-4963-bb9f-2b4182dc1d50 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Processing event network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:58:13.863133 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.407s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:13.863517 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:58:13.868455 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.901s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:13.984455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:13.986117 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:14.004367 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:14.157582 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:14.158033 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:14.282225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:14.282413 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:14.282628 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attaching volume 9096cd7c-ff6e-400d-970c-b20f58ea3991 to /dev/vdb
Jun 26 02:58:14.294817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:14.295792 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:14.297635 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:58:14.325349 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:14.337086 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:14.361824 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:14.383991 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:58:14.383991 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:58:14.383991 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:14.384290 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:14.402491 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442694.402012, 93a2c213-03d0-4ecb-8d98-05705ea10619 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:14.402598 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] VM Started (Lifecycle Event)
Jun 26 02:58:14.405589 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:58:14.406043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:14.411361 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:14.411361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:58:14.411361 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance spawned successfully.
Jun 26 02:58:14.411361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:58:14.416774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:14.418075 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081'] 
Jun 26 02:58:14.418244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:14.419002 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:14.419571 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:14.419807 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating existing volume attachment record: 46cbf6aa-0865-4f60-a6af-a2b0df100085 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:14.482271 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:58:14.660646 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:14.801272 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:14.880190 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Successfully created port: 81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:58:14.890052 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:58:14.907692 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:14.918588 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:14.921984 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.922261 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.922884 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.923216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.923799 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.924272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:14.969496 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:14.969791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:14.969950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:14.970386 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:14.970606 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:14.985161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:14.985711 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:14.986349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:14.986630 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:14.987013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:14.987189 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:15.000407 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:15.000407 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:15.006997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:15.006997 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991] added
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:15.017508 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:15.017823 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:15.018057 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:15.018328 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991] added
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:15.019776 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:15.020086 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:15.020134 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:15.020272 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:15.167682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.304s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:15.240319 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Deleted allocations for instance 21df308b-5507-4700-990f-8ec3d8a12587
Jun 26 02:58:15.246471 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:15.393361 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:58:15.410206 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:15.414775 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Successfully updated port: 81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:58:15.421818 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:58:15.422187 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442695.4219422, 93a2c213-03d0-4ecb-8d98-05705ea10619 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:15.422371 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] VM Paused (Lifecycle Event)
Jun 26 02:58:15.429490 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Took 6.58 seconds to spawn the instance on the hypervisor.
Jun 26 02:58:15.429756 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:15.462023 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-changed-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:15.462142 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Refreshing instance network info cache due to event network-changed-81604efa-f885-4762-931a-48f554869e5d. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:15.462299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] Acquiring lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:15.462379 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] Acquired lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:15.462499 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Refreshing network info cache for port 81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:15.885633 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:15.886118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:15.886368 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:15.886470 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:15.886642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] No waiting events found dispatching network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:15.886804 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-70b25b13-ead0-44b3-870a-7110e6103b67 req-fd4a54fa-2458-441e-8717-f26b7be48ce7 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received unexpected event network-vif-plugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 for instance with vm_state active and task_state None.
Jun 26 02:58:15.897422 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Booting with volume snapshot 9aa42879-c80c-4473-b65e-e32e42942aa4 at /dev/vda
Jun 26 02:58:15.913830 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:15.918136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:15.924902 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:15.931373 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442695.9306161, 93a2c213-03d0-4ecb-8d98-05705ea10619 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:15.931373 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] VM Resumed (Lifecycle Event)
Jun 26 02:58:15.945571 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Took 12.07 seconds to build instance.
Jun 26 02:58:15.964740 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:16.018793 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:16.020727 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:16.032397 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:16.034062 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:16.036227 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.047056 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.049445 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:16.053025 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.061316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.061316 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.061316 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:16.061595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.061595 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.061595 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:16.069588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.069588 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.069588 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:16.069795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.069795 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.069795 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:16.101051 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.40.100,3260]
Jun 26 02:58:16.101051 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:16.101051 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.115768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.125597 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.50.100,3260]
Jun 26 02:58:16.125597 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:16.125597 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.131789 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.131789 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.131789 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.131789 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.131789 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:16.132114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.132114 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.132114 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.132114 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.132114 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:16.132277 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:16.132376 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:16.132956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('7', '-', '-', 0) found on session 201 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:16.133138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:16.145220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:16.152668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 201 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:16.152668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:16.159873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.159873 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.159873 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.159873 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.159873 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:16.160095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.160095 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:16.160095 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.160095 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:16.160095 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:16.160396 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:16.160563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:16.161313 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('8', '-', '-', 0) found on session 202 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:16.161466 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:16.182967 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 202 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:16.183287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:16.225721 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:16.252167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-b1ab92aa-4a77-42ae-a9f0-39b46f17a5e7 tempest-VolumeMultiattachTests-190007800 tempest-VolumeMultiattachTests-190007800-project-member] Lock "21df308b-5507-4700-990f-8ec3d8a12587" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:16.420179 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:16.434263 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:16.437334 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:16.448788 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-76772d0f-beb6-43a5-bd63-af75cbfe655e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.584s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:16.733622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d231d095-3c18-4777-b6c0-6cbbed936190 req-891c1ddd-8617-4987-9cee-f27153c2cedb service nova] Releasing lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:16.734102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:16.734269 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:58:16.988599 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:58:17.298847 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:17.304694 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-changed-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:17.304838 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Refreshing instance network info cache due to event network-changed-0f968dc3-43a3-476c-ad97-a8144fbc7281. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:17.305904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] Acquiring lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:17.306028 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] Acquired lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:17.306140 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Refreshing network info cache for port 0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:17.439844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:17.481811 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:17.619798 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Updating instance_info_cache with network_info: [{"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:17.810849 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:18.008040 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found WWN 330000000f88daec2 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:58:18.008300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:18.008470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000f88daec2', 'path': '/dev/dm-0', 'multipath_id': '330000000f88daec2'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:18.008603 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f88daec2', 'path': '/dev/dm-0', 'multipath_id': '330000000f88daec2'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:58:18.011058 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:18.122664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-a63e9cf1-c6fc-4500-9e78-c09864abe653" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:18.122664 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance network_info: |[{"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:58:18.165749 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:18.251347 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:18.321417 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updated VIF entry in instance network info cache for port 0f968dc3-43a3-476c-ad97-a8144fbc7281. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:58:18.321882 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updating instance_info_cache with network_info: [{"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:18.513854 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to attach volume 9096cd7c-ff6e-400d-970c-b20f58ea3991 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:   <alias name="ua-9096cd7c-ff6e-400d-970c-b20f58ea3991"/>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:   <serial>9096cd7c-ff6e-400d-970c-b20f58ea3991</serial>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:18.515388 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:58:18.823752 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a5f91b0e-6e03-4515-a57a-9e1eef733df1 req-6714c9ae-8b46-45e1-8818-9f69a14aad55 service nova] Releasing lock "refresh_cache-93a2c213-03d0-4ecb-8d98-05705ea10619" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:19.414488 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:19.436259 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:19.464584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:19.515937 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:19.516305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:19.525706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:19.526833 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081'] 
Jun 26 02:58:19.527004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:19.527156 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:19.527388 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:19.527627 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Updating existing volume attachment record: 10201da7-fa66-4c84-b987-023555620813 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:19.920906 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:19.934010 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:19.958512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:20.090241 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:20.090241 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:20.090317 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:20.090460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:20.090612 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:20.090747 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ab375608-3294-43dd-ba53-fdd9f35fa2cd req-13c01a71-7c7f-45d9-9626-7f138570b5e4 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received unexpected event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with vm_state active and task_state reboot_started.
Jun 26 02:58:20.180515 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:20.180740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:20.180870 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:20.181028 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No VIF found with MAC fa:16:3e:1f:2e:0d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:20.185539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:20.277284 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999503946999994 future=<Future at 0x72e29c4efdd0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:20.455968 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance shutdown successfully.
Jun 26 02:58:20.891535 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:20.916989 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:20.920877 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.002320 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.033674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.214595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.216921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.222707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.240334 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:21.641047 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:58:21.642238 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:58:21.642495 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Creating image(s)
Jun 26 02:58:21.642794 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:58:21.642949 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Ensure instance console log exists: /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:58:21.643175 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:21.643328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:21.643445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:21.643956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Start _get_guest_xml network_info=[{"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '10201da7-fa66-4c84-b987-023555620813', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a63e9cf1-c6fc-4500-9e78-c09864abe653', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'serial': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:58:21.647508 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:58:21.648463 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1997406335', uuid='a63e9cf1-c6fc-4500-9e78-c09864abe653'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442701.6481717) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:58:21.649717 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:58:21.650031 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:58:21.651258 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:58:21.651451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:58:21.653091 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:58:21.653409 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:58:21.653592 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:58:21.653710 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:58:21.653863 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:58:21.653989 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:58:21.654116 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:58:21.654308 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:58:21.654565 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:58:21.654758 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:58:21.654891 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:58:21.655050 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:58:21.668682 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:21.669167 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:21.669872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:21.670314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:21.670618 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:21.671545 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Removed pending STOPPED event for 92ff8d21-f526-4702-b4ad-8693a8fd455a due to new event <LifecycleEvent: 1782442701.671058, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Resumed> {{(pid=98991) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 26 02:58:21.671916 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442701.671058, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:21.672135 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Resumed (Lifecycle Event)
Jun 26 02:58:21.678639 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance running successfully.
Jun 26 02:58:21.679031 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance soft rebooted successfully.
Jun 26 02:58:21.679161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:21.686310 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:21.689206 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:21.689510 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:21.691073 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:21.692063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:21.692315 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:21.701619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:21.701619 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:21.709656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:21.709656 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8] added
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:21.719914 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:21.720236 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:21.720236 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:21.720457 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8] added
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:21.722436 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:21.722698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:21.722818 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:21.722965 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:21.765539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-99d7d59d-bca2-411e-8768-97a741f9e2a0 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.483s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:22.157897 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:22.158111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:22.158162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:22.158272 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:22.158439 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:22.158548 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received unexpected event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with vm_state active and task_state None.
Jun 26 02:58:22.159089 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:22.159869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:22.159869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:22.160112 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:22.160174 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:22.160267 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received unexpected event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with vm_state active and task_state None.
Jun 26 02:58:22.160381 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:22.160530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:22.160675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:22.160779 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:22.161022 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:22.161022 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-770d8ed2-8902-4fd6-9a7c-1cce60ec6497 req-92584ffd-9aaa-4385-bc33-0fa252fe7b49 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received unexpected event network-vif-plugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with vm_state active and task_state None.
Jun 26 02:58:22.175122 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:22.177448 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:22.193751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-a9d02131-eb23-4e20-a24e-86170bbcb3c1 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.481s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:22.444232 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:22.680166 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442702.6798172, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:22.680473 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Started (Lifecycle Event)
Jun 26 02:58:22.720904 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:22.723355 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:22.734598 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:22.742239 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.749169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.754716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.763026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.763026 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.763026 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.763026 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.763026 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:22.763282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.763282 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.763282 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.763282 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.763282 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:22.768622 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.768622 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.768622 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.768622 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.768622 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:22.768793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.768793 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.768793 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.768793 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.768793 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:22.800496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.40.100,3260]
Jun 26 02:58:22.800496 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:22.800496 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.809865 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.821640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.50.100,3260]
Jun 26 02:58:22.821640 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:22.821640 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.827168 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.827456 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:22.827713 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:22.827877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:22.828653 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('9', '-', '-', 0) found on session 203 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:22.828796 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:22.834297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:22.843867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 203 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:22.843867 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.853532 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:22.853767 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:22.853924 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:22.854053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:22.854715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('10', '-', '-', 0) found on session 204 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:22.854815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:22.871044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 204 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:22.871044 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:23.182918 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:23.185073 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:23.692849 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:58:23.927922 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003743520001080469 future=<Future at 0x72e27c4a94c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:23.928487 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442688.9274237, 21df308b-5507-4700-990f-8ec3d8a12587 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:23.928690 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:23.928910 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] VM Stopped (Lifecycle Event)
Jun 26 02:58:23.929509 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.347178931000144 future=<Future at 0x72e29c4efdd0 state=cancelled>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:23.930144 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.346518362000097 future=<Future at 0x72e29c4efdd0 state=cancelled>) was cancelled while queued, skipping {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:23.930236 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:24.431572 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 21df308b-5507-4700-990f-8ec3d8a12587] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:24.709862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 3300000004f396e86 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:58:24.709862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:24.709862 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000004f396e86', 'path': '/dev/dm-1', 'multipath_id': '3300000004f396e86'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:24.709862 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f396e86', 'path': '/dev/dm-1', 'multipath_id': '3300000004f396e86'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:58:25.214504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1997406335',display_name='tempest-TestVolumeBootPattern-server-1997406335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1997406335',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-0f0xjzgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:15Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a63e9cf1-c6fc-4500-9e78-c09864abe653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:58:25.214745 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:25.215266 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:25.215869 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid a63e9cf1-c6fc-4500-9e78-c09864abe653 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:25.540850 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:25.541079 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <uuid>a63e9cf1-c6fc-4500-9e78-c09864abe653</uuid>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <name>instance-0000004a</name>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1997406335</nova:name>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:58:21</nova:creationTime>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         <nova:port uuid="81604efa-f885-4762-931a-48f554869e5d">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="serial">a63e9cf1-c6fc-4500-9e78-c09864abe653</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="uuid">a63e9cf1-c6fc-4500-9e78-c09864abe653</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/disk.config"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <alias name="ua-f6081f41-8c5f-4ee7-a631-3b91cc581ec8"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <serial>f6081f41-8c5f-4ee7-a631-3b91cc581ec8</serial>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:8f:b9:12"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <target dev="tap81604efa-f8"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/console.log" append="off"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:58:25.718917 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Preparing to wait for external event network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1997406335',display_name='tempest-TestVolumeBootPattern-server-1997406335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1997406335',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-0f0xjzgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:15Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a63e9cf1-c6fc-4500-9e78-c09864abe653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:25.721415 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:58:25.721864 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.722113 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:25.722409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:58:25.723175 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.723349 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c2b382d-91f4-5e0f-9e87-ffe431693d2b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:25.724151 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.725645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:25.727168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.727305 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81604efa-f8, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:25.727599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81604efa-f8, col_values=(('qos', UUID('d329ec5f-fcbc-4f57-bfff-33b568cbf5ce')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:25.727743 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81604efa-f8, col_values=(('external_ids', {'iface-id': '81604efa-f885-4762-931a-48f554869e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:b9:12', 'vm-uuid': 'a63e9cf1-c6fc-4500-9e78-c09864abe653'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:25.728435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.729384 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:25.734462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:25.735359 np0000003683 nova-compute[98991]: INFO os_vif [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8')
Jun 26 02:58:26.044153 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Detaching volume 9096cd7c-ff6e-400d-970c-b20f58ea3991
Jun 26 02:58:26.087134 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to driver detach volume 9096cd7c-ff6e-400d-970c-b20f58ea3991 from mountpoint /dev/vdb
Jun 26 02:58:26.091674 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-9096cd7c-ff6e-400d-970c-b20f58ea3991 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:26.092813 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-9096cd7c-ff6e-400d-970c-b20f58ea3991 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:26.092926 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Attempting to detach device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <alias name="ua-9096cd7c-ff6e-400d-970c-b20f58ea3991"/>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <serial>9096cd7c-ff6e-400d-970c-b20f58ea3991</serial>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:26.093189 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:26.105624 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config.
Jun 26 02:58:26.105816 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] (1/8): Attempting to detach device vdb with device alias ua-9096cd7c-ff6e-400d-970c-b20f58ea3991 from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <alias name="ua-9096cd7c-ff6e-400d-970c-b20f58ea3991"/>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <serial>9096cd7c-ff6e-400d-970c-b20f58ea3991</serial>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:26.106136 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:26.573795 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442706.5733726, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => ua-9096cd7c-ff6e-400d-970c-b20f58ea3991> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:58:26.574835 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9096cd7c-ff6e-400d-970c-b20f58ea3991 for instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:58:26.576957 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config.
Jun 26 02:58:26.578011 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:58:26.578307 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:26.578468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:26.578825 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:26.579138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9096cd7c-ff6e-400d-970c-b20f58ea3991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:58:26.579296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:26.604564 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:26.604842 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:26.605067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '204')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:58:26.605067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', '201')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:26.605892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991', '202')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:26.606609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7b5e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:58:26.606808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:58:26.607088 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flush multipath device 330000000f88daec2 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:58:26.645126 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:26.693057 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:26.752930 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:58:26.753314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:58:26.754018 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:58:26.766979 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:58:26.767149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:58:26.777946 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.804636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.40.100,3260]
Jun 26 02:58:26.804636 np0000003683 nova-compute[98991]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:26.804636 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.824297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.837161 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.876684 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.50.100,3260]
Jun 26 02:58:26.876684 np0000003683 nova-compute[98991]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-9096cd7c-ff6e-400d-970c-b20f58ea3991, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:26.876684 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.890644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:26.890836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:26.890950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== disconnect_volume: return (312ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:26.891076 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:58:27.252442 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:27.252853 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:27.253127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:8f:b9:12, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:27.253618 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Using config drive
Jun 26 02:58:27.443362 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:27.453058 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:27.758450 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:27.863323 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Creating config drive at /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/disk.config
Jun 26 02:58:27.866146 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj0jjrv9m {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:27.921088 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj0jjrv9m" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:28.344428 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.373706 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.461839 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-40497d61-e889-4cec-9ebe-87e2622ba304 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.921s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:28.470614 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.566245 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5b541781-798a-45fa-b558-43df6624863c req-b115b297-ca4a-401e-a058-8760f441b1a9 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:28.567130 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5b541781-798a-45fa-b558-43df6624863c req-b115b297-ca4a-401e-a058-8760f441b1a9 service nova] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:28.567438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5b541781-798a-45fa-b558-43df6624863c req-b115b297-ca4a-401e-a058-8760f441b1a9 service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:28.567714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5b541781-798a-45fa-b558-43df6624863c req-b115b297-ca4a-401e-a058-8760f441b1a9 service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:28.568090 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5b541781-798a-45fa-b558-43df6624863c req-b115b297-ca4a-401e-a058-8760f441b1a9 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Processing event network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:58:28.730801 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.733409 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.734943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.736366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:28.756848 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:29.205188 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442709.2047617, a63e9cf1-c6fc-4500-9e78-c09864abe653 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:29.205825 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:58:29.206072 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] VM Started (Lifecycle Event)
Jun 26 02:58:29.208729 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:58:29.210903 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance spawned successfully.
Jun 26 02:58:29.211241 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:58:29.705433 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:29.708779 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:29.711286 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:29.720327 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:29.720512 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:29.720851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:29.721129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:29.721425 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:29.721715 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:58:30.016016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.016494 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:30.211424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:58:30.211424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:58:30.211424 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:58:30.212164 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Triggering sync for uuid a63e9cf1-c6fc-4500-9e78-c09864abe653 {{(pid=98991) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 26 02:58:30.212419 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.213375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.213375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:30.213846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.214171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:30.214497 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 26.64 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:30.214747 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.215324 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:58:30.215596 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442710.215396, a63e9cf1-c6fc-4500-9e78-c09864abe653 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:30.215770 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] VM Paused (Lifecycle Event)
Jun 26 02:58:30.229634 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Took 8.59 seconds to spawn the instance on the hypervisor.
Jun 26 02:58:30.229954 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:30.519658 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:30.625696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:30.626315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:30.626315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:30.626315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:30.626519 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] No waiting events found dispatching network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:30.626519 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-486eae80-57ef-4e16-876d-01e40679217b req-5348d867-3fda-4717-9155-37e82c5a579a service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received unexpected event network-vif-plugged-81604efa-f885-4762-931a-48f554869e5d for instance with vm_state active and task_state None.
Jun 26 02:58:30.721184 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:30.722080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:30.722763 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:30.723536 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442710.7233224, a63e9cf1-c6fc-4500-9e78-c09864abe653 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:30.723647 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] VM Resumed (Lifecycle Event)
Jun 26 02:58:30.730204 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:30.737187 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Took 19.33 seconds to build instance.
Jun 26 02:58:31.226031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:31.227775 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:58:31.239100 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.835s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:31.239454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.025s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:31.239651 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:58:31.239785 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:31.525098 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:31.527375 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.313s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:32.030594 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:32.083135 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:32.083351 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:32.083610 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:32.083783 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:32.083923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:32.086192 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Terminating instance
Jun 26 02:58:32.445634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:32.589469 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:58:32.606315 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:32.608080 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:32.634057 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:32.650324 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:32.650491 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:32.650686 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attaching volume dc2a7d68-55bd-4832-94fa-6496cb997af9 to /dev/vdb
Jun 26 02:58:32.656608 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:32.692033 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:32.703506 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:32.727912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:32.760832 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:32.761946 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:32.762292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:32.762490 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:32.762704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] No waiting events found dispatching network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:32.762887 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ff650552-c076-4dab-bc1b-03bfb2d651fa req-fe4d2560-9f65-4298-b11d-1da6f236aecf service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:58:32.773953 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:32.774215 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:32.787847 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating existing volume attachment record: 495ccaad-3a38-4fc3-af09-317f5ea5125a {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:32.939888 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999648024999715 future=<Future at 0x72e27c411040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:32.940142 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998216320999745 future=<Future at 0x72e27c411040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:32.940353 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.997965043000022 future=<Future at 0x72e27c411040 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:32.940891 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Instance destroyed successfully.
Jun 26 02:58:32.941368 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid a63e9cf1-c6fc-4500-9e78-c09864abe653 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:33.349983 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:33.350496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:33.350651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:33.351027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:33.351266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:33.364660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:33.365195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:33.365575 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:33.365822 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:33.366461 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:33.368834 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:33.377417 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:33.377417 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:33.382679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:33.382679 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9] added
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:33.390847 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:33.391125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:33.391167 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:33.391294 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9] added
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:33.394081 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:33.394364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:33.394364 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:33.394546 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:33.446046 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1997406335',display_name='tempest-TestVolumeBootPattern-server-1997406335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1997406335',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:58:30Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-0f0xjzgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:58:30Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a63e9cf1-c6fc-4500-9e78-c09864abe653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:58:33.446046 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "81604efa-f885-4762-931a-48f554869e5d", "address": "fa:16:3e:8f:b9:12", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81604efa-f8", "ovs_interfaceid": "81604efa-f885-4762-931a-48f554869e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:33.446046 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:33.446046 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:58:33.447213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:33.447552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81604efa-f8, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:33.456624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:33.457624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:33.458624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:33.458787 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d329ec5f-fcbc-4f57-bfff-33b568cbf5ce) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:33.459299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:33.459945 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:33.460255 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:33.462866 np0000003683 nova-compute[98991]: INFO os_vif [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b9:12,bridge_name='br-int',has_traffic_filtering=True,id=81604efa-f885-4762-931a-48f554869e5d,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81604efa-f8')
Jun 26 02:58:33.464121 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:58:33.464610 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:33.464925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:34.391777 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:34.395120 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:34.404419 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:34.410996 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.420655 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.425204 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.434421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.434421 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.434421 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.434421 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.434421 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:34.434740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.434740 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.434740 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.434740 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.434740 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:34.440626 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.440626 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.440626 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.440626 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.440626 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:34.440889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.440889 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.440889 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.440889 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.440889 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:34.465877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.40.100,3260]
Jun 26 02:58:34.465877 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:34.465877 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.474418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.50.100,3260]
Jun 26 02:58:34.474418 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:34.474418 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.479648 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.487260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.495029 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.495240 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:34.495379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:34.495531 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:34.496321 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('7', '-', '-', 0) found on session 205 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:34.496428 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.502779 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:34.503026 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:34.503314 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:34.503488 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:34.504431 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('8', '-', '-', 0) found on session 206 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:34.504591 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:34.510758 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 205 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:34.510839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:34.518953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:34.518953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:34.811270 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:34.811826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] Acquiring lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:34.812117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:34.812668 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:34.812862 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] No waiting events found dispatching network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:58:34.813029 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c5d0b1de-788c-4e26-8a59-7cada4c45910 req-bad6735f-4758-47a9-8544-bb3b2fd0e450 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-unplugged-81604efa-f885-4762-931a-48f554869e5d for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:58:35.367042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:58:36.383465 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found WWN 330000000816851d8 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:58:36.383889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:36.383958 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000816851d8', 'path': '/dev/dm-0', 'multipath_id': '330000000816851d8'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:36.384116 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000816851d8', 'path': '/dev/dm-0', 'multipath_id': '330000000816851d8'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:58:36.384434 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.920s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:36.384806 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:58:36.385085 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:58:36.388943 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:36.414425 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:36.414724 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:36.414963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '206')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:58:36.414963 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '203')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:36.415985 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8', '204')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:36.417221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c456a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:58:36.417447 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:58:36.417680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 3300000004f396e86 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:58:36.504943 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:36.563244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:36.602740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:58:36.602911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:58:36.603765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:58:36.613931 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:58:36.614135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:58:36.623861 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.652468 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.40.100,3260]
Jun 26 02:58:36.652468 np0000003683 nova-compute[98991]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:36.652468 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.666680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.680961 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.715244 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.50.100,3260]
Jun 26 02:58:36.715244 np0000003683 nova-compute[98991]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-f6081f41-8c5f-4ee7-a631-3b91cc581ec8, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:36.715244 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.733638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:36.733887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:36.733887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (3269ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:36.734074 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:58:36.734309 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Deleting instance files /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653_del
Jun 26 02:58:36.734753 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Deletion of /opt/stack/data/nova/instances/a63e9cf1-c6fc-4500-9e78-c09864abe653_del complete
Jun 26 02:58:36.892738 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to attach volume dc2a7d68-55bd-4832-94fa-6496cb997af9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:   <alias name="ua-dc2a7d68-55bd-4832-94fa-6496cb997af9"/>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:   <serial>dc2a7d68-55bd-4832-94fa-6496cb997af9</serial>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:36.894410 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:58:37.245070 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Took 4.66 seconds to destroy the instance on the hypervisor.
Jun 26 02:58:37.246426 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:58:37.246617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:58:37.246709 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:58:37.247015 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:37.311762 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:37.447147 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:37.574239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-06b7e761-89de-4498-8838-7372d04e6b62 req-5ed9bf4a-7e22-4566-bf6e-68478dca7293 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Received event network-vif-deleted-81604efa-f885-4762-931a-48f554869e5d {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:37.574431 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-06b7e761-89de-4498-8838-7372d04e6b62 req-5ed9bf4a-7e22-4566-bf6e-68478dca7293 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Neutron deleted interface 81604efa-f885-4762-931a-48f554869e5d; detaching it from the instance and deleting it from the info cache
Jun 26 02:58:37.576269 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-06b7e761-89de-4498-8838-7372d04e6b62 req-5ed9bf4a-7e22-4566-bf6e-68478dca7293 service nova] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Detach interface failed, port_id=81604efa-f885-4762-931a-48f554869e5d, reason: Instance a63e9cf1-c6fc-4500-9e78-c09864abe653 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:58:38.028011 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:38.459897 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:38.529992 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Took 1.28 seconds to deallocate network for instance.
Jun 26 02:58:38.544683 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:38.544832 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:38.544919 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:38.545068 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No VIF found with MAC fa:16:3e:1f:2e:0d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:39.079448 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 02:58:39.081455 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Deleting volume: f6081f41-8c5f-4ee7-a631-3b91cc581ec8 {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 02:58:39.621661 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:39.622147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:39.667101 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Refreshing inventories for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 26 02:58:39.708534 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Updating ProviderTree inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 26 02:58:39.708708 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 02:58:39.749082 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Refreshing aggregate associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, aggregates: None {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 26 02:58:39.794548 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Refreshing trait associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_RISCV64,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_LAN9118 {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 26 02:58:39.998702 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:39.998900 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:40.091663 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-cadd6f1b-1356-411e-b9d0-c20a1c8a4736 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.441s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:40.502149 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:41.008445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.387s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:41.053335 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance a63e9cf1-c6fc-4500-9e78-c09864abe653
Jun 26 02:58:42.061060 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52f43254-2ca2-4ac6-941e-536d011602d4 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a63e9cf1-c6fc-4500-9e78-c09864abe653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.978s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:42.449919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:43.276637 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:43.277149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:43.475993 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:43.779265 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Detaching volume dc2a7d68-55bd-4832-94fa-6496cb997af9
Jun 26 02:58:43.815941 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to driver detach volume dc2a7d68-55bd-4832-94fa-6496cb997af9 from mountpoint /dev/vdb
Jun 26 02:58:43.820381 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-dc2a7d68-55bd-4832-94fa-6496cb997af9 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:43.821466 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-dc2a7d68-55bd-4832-94fa-6496cb997af9 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:58:43.821599 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Attempting to detach device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <alias name="ua-dc2a7d68-55bd-4832-94fa-6496cb997af9"/>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <serial>dc2a7d68-55bd-4832-94fa-6496cb997af9</serial>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:43.821804 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:43.826655 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config.
Jun 26 02:58:43.826783 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] (1/8): Attempting to detach device vdb with device alias ua-dc2a7d68-55bd-4832-94fa-6496cb997af9 from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <alias name="ua-dc2a7d68-55bd-4832-94fa-6496cb997af9"/>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <serial>dc2a7d68-55bd-4832-94fa-6496cb997af9</serial>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:43.827025 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:58:44.253981 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442724.2536142, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => ua-dc2a7d68-55bd-4832-94fa-6496cb997af9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:58:44.254521 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dc2a7d68-55bd-4832-94fa-6496cb997af9 for instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:58:44.256936 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config.
Jun 26 02:58:44.257982 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:58:44.258294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:44.258456 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:44.258994 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:44.259301 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc2a7d68-55bd-4832-94fa-6496cb997af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:58:44.259418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:58:44.283237 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:44.283237 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:44.283237 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:44.283237 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:44.283237 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9 (non-flash)
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '206')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:58:44.283745 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '205')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:44.284311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9', '206')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:58:44.285109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c48e8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:58:44.285278 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:58:44.285514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flush multipath device 330000000816851d8 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:58:44.314802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:44.361374 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:58:44.411250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:58:44.411471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:58:44.412470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:58:44.427011 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:58:44.427316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:58:44.440685 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.473667 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.40.100,3260]
Jun 26 02:58:44.473667 np0000003683 nova-compute[98991]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:44.473667 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.490706 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.503692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.534776 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.50.100,3260]
Jun 26 02:58:44.534776 np0000003683 nova-compute[98991]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-dc2a7d68-55bd-4832-94fa-6496cb997af9, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:44.534776 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.548097 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:44.548097 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:44.548203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== disconnect_volume: return (289ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:44.548316 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:58:45.093060 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:45.971768 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:46.098444 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c254210b-5599-4f87-92f0-9db7039c82f5 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.821s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:47.451909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:47.712981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:47.713359 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:47.798137 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:47.798297 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:47.938742 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00036874100032946444 future=<Future at 0x72e27c411040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:47.939325 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Emitting event <LifecycleEvent: 1782442712.9382455, a63e9cf1-c6fc-4500-9e78-c09864abe653 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:58:47.939515 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:58:47.939673 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] VM Stopped (Lifecycle Event)
Jun 26 02:58:48.216222 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:48.299860 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:58:48.442096 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8b96697e-4a52-4e32-a71a-85f302456361 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: a63e9cf1-c6fc-4500-9e78-c09864abe653] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:58:48.484720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:48.846445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:48.846650 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:48.849643 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:58:48.849778 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Claim successful on node np0000003683
Jun 26 02:58:49.221670 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:50.051363 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:58:50.051722 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:58:50.346174 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:50.346355 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:50.346582 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attaching volume 2156e511-9dd8-4946-9892-c79f06d638dd to /dev/vdb
Jun 26 02:58:50.381003 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:50.392142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:50.412941 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:50.455875 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:50.456169 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:50.463992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:50.465066 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:58:50.465195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:50.465265 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:50.465493 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:50.465737 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating existing volume attachment record: 9018da1c-1e73-406a-8812-82d0cec9c723 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:50.554743 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:58:51.014406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:51.014813 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:51.014988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:51.015449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:51.015743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:51.029347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:51.030003 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:51.030611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:51.030938 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:51.031349 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:51.031598 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:51.043297 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:51.043297 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:51.048765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:51.048765 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd] added
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:51.056266 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:51.056734 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:51.056734 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:51.056820 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd] added
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:51.059694 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:51.059868 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:51.060005 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:51.060129 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:51.063750 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.217s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:51.064167 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:58:51.569899 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:58:51.570136 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:58:51.570554 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:51.570843 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:51.639304 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:58:52.052799 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Successfully created port: 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:58:52.060394 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:52.064622 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:52.072835 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.075767 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:52.079556 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.085649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.091726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.099012 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.099012 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.099012 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:52.099209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.099209 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.099209 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:52.104832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.104832 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.104832 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:52.104984 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.104984 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.104984 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:52.127936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.50.100,3260]
Jun 26 02:58:52.127936 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:52.127936 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.139810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.145266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.40.100,3260]
Jun 26 02:58:52.145266 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:52.145266 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.155373 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:52.155693 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:52.155770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:52.157008 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:52.157344 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('7', '-', '-', 0) found on session 207 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:52.157452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:52.169764 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.169764 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.169764 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.169764 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.169764 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:52.169983 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.169983 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:52.169983 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.169983 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:52.169983 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:52.170279 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:52.170439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:52.171229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] HCTL ('8', '-', '-', 0) found on session 208 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:52.171387 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:52.179303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 207 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:52.179545 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:52.186978 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Searching for a device in session 208 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:52.187191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:52.454028 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:52.554576 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Successfully updated port: 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:58:52.578925 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:58:52.614765 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-changed-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:52.614903 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Refreshing instance network info cache due to event network-changed-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:52.615111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] Acquiring lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:52.615160 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] Acquired lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:52.615312 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Refreshing network info cache for port 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:53.031250 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 02:58:53.056521 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:53.083058 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Booting with volume 658d91ad-0838-47a5-926c-5b8fdbdcf1db at /dev/vda
Jun 26 02:58:53.117646 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:53.120170 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:53.131205 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:53.152228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:53.182454 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:53.200986 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:53.201228 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:53.209920 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:53.210982 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:58:53.211095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:53.211196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:53.211399 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:53.211600 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updating existing volume attachment record: 6929651b-45ef-40cf-9f90-4887e8205baa {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:53.315370 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:53.499669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:53.559970 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:53.560167 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:53.817748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1402e8ae-9ab1-444d-8a8f-d7a804099833 req-fe365fee-fb11-4c49-815c-7b620c335825 service nova] Releasing lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:53.818250 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:53.818413 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:58:54.047941 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found WWN 3300000004d6038b7 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:58:54.048300 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:54.048449 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000004d6038b7', 'path': '/dev/dm-0', 'multipath_id': '3300000004d6038b7'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:54.048636 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d6038b7', 'path': '/dev/dm-0', 'multipath_id': '3300000004d6038b7'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:58:54.052990 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:54.064947 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'flavor' on Instance uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:54.385731 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:58:54.523597 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:54.555649 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to attach volume 2156e511-9dd8-4946-9892-c79f06d638dd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:   <alias name="ua-2156e511-9dd8-4946-9892-c79f06d638dd"/>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:   <serial>2156e511-9dd8-4946-9892-c79f06d638dd</serial>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:58:54.557091 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:58:54.638283 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updating instance_info_cache with network_info: [{"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:55.070389 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:55.140150 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:58:55.140421 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance network_info: |[{"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:58:55.307729 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:58:55.308736 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:58:55.308980 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Creating image(s)
Jun 26 02:58:55.309257 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:58:55.309374 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Ensure instance console log exists: /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:58:55.309607 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:55.309759 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:55.309869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:55.310292 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Start _get_guest_xml network_info=[{"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6929651b-45ef-40cf-9f90-4887e8205baa', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5f20da65-2d84-4541-9190-ea4e4da46e0b', 'attached_at': '', 'detached_at': '', 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'serial': '658d91ad-0838-47a5-926c-5b8fdbdcf1db'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:58:55.312953 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:58:55.314021 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-838288422', uuid='5f20da65-2d84-4541-9190-ea4e4da46e0b'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442735.3136716) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:58:55.315211 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:58:55.315524 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:58:55.316467 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:58:55.316704 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:58:55.317444 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:58:55.317701 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:58:55.317818 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:58:55.317906 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:58:55.318026 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:58:55.318108 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:58:55.318196 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:58:55.318336 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:58:55.318435 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:58:55.318557 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:58:55.318691 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:58:55.318760 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:58:55.328074 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:55.328354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:55.328501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:55.328798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:55.329036 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:55.342730 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:55.343381 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:55.343990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:55.344157 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:55.344714 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:55.345084 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:55.356010 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:55.356010 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:55.362179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:55.362179 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db] added
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:55.369773 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:55.370116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:55.370208 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:55.370398 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db] added
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:55.374579 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:55.374837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:55.374880 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:55.375044 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:56.148451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:56.148972 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:56.148972 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Attaching volume ae9dc947-c3b4-46be-bb51-232550f9759e to /dev/vdb
Jun 26 02:58:56.184276 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:56.193977 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:56.194202 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:56.195096 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:58:56.195385 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] No VIF found with MAC fa:16:3e:1f:2e:0d, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:58:56.198857 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:58:56.223498 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:56.266714 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:58:56.267099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:58:56.275280 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:58:56.277913 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1f:2e0d', 'fe80::7421:51ff:fe25:bbb9', 'fe80::fc16:3eff:fe2f:d2c8', 'fe80::a87e:a5ff:fe85:a081', 'fe80::fc16:3eff:fe8a:18fc', 'fe80::d8b4:17ff:fedc:9e5b'] 
Jun 26 02:58:56.278109 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:58:56.278230 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:58:56.278524 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:56.278842 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updating existing volume attachment record: a7bbd065-8256-417d-b34d-d92bb3e9a17d {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:58:56.370855 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:56.375557 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:56.385225 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:56.391519 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.398084 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.404418 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.413277 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.413277 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.413277 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.413277 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.413277 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:56.413450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.413450 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.413450 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.413450 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.413450 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:56.419253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.419253 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.419253 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.419253 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.419253 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:56.419409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.419409 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.419409 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.419409 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.419409 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:56.445715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.50.100,3260]
Jun 26 02:58:56.445715 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:56.445715 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.455956 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.40.100,3260]
Jun 26 02:58:56.455956 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:56.455956 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.457669 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.469873 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.475889 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.476133 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:56.476881 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:56.476881 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:56.477780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('9', '-', '-', 0) found on session 209 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:56.477919 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.485892 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:56.486157 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:56.486489 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:56.486624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:56.487229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('10', '-', '-', 0) found on session 210 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:56.487368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:56.494000 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 209 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:56.494000 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:56.500922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 210 and hctl ['10', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:56.854469 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:56.854933 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:58:56.858946 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '93a2c213-03d0-4ecb-8d98-05705ea10619', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'serial': 'ae9dc947-c3b4-46be-bb51-232550f9759e'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:58:56.862288 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:58:56.862634 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:58:56.862762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:57.455522 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:57.500671 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 210 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:57.501101 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:57.747108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-79a24fb0-80b4-4706-9524-bc17c1e21647 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.401s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:58.344086 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:58.344252 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:58:58.344461 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:58:58.364950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000ad3ece3d for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:58:58.365273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:58.365562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000ad3ece3d', 'path': '/dev/dm-1', 'multipath_id': '330000000ad3ece3d'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:58:58.365735 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ad3ece3d', 'path': '/dev/dm-1', 'multipath_id': '330000000ad3ece3d'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:58:58.366007 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.503s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:58.366217 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:58:58.378995 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:58.379760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:58:58.380524 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:58.380524 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:58.380785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:58:58.381039 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:58.392891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:58.392891 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:58.398020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:58:58.398020 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e] added
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:58.406197 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:58.406523 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:58.407254 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:58.407470 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e] added
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:58:58.411538 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:58.411970 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:58:58.411970 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:58:58.412075 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:58:58.511941 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:58.741988 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:58:58.742271 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing instance network info cache due to event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:58:58.742402 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:58:58.742516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:58:58.742651 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:58:58.849036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:58.849258 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:58.849440 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:58.849629 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 02:58:58.870985 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838288422',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838288422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-volume-backed-server-838288422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMdreGe7raEJxhXV2aosTwZCvTUVTnfbNklxU4eKBx4C7OtXqZoeFM7gEgmzht+nYShKaRoVI8267zysRujsv19ybzI3drTp9uKSqvvY8sLYMh322F5Fb7uL7cWOZXttA==',key_name='tempest-keypair-1282475371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-uxi41twm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=5f20da65-2d84-4541-9190-ea4e4da46e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:58:58.871386 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:58.872023 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:58.872679 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f20da65-2d84-4541-9190-ea4e4da46e0b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:58:59.245052 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <uuid>5f20da65-2d84-4541-9190-ea4e4da46e0b</uuid>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <name>instance-0000004b</name>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-838288422</nova:name>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:58:55</nova:creationTime>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         <nova:port uuid="6aece55f-3b8d-4753-a7e7-0fb9cd5d3679">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="serial">5f20da65-2d84-4541-9190-ea4e4da46e0b</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="uuid">5f20da65-2d84-4541-9190-ea4e4da46e0b</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/disk.config"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <alias name="ua-658d91ad-0838-47a5-926c-5b8fdbdcf1db"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <serial>658d91ad-0838-47a5-926c-5b8fdbdcf1db</serial>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:e4:7a:6b"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <target dev="tap6aece55f-3b"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/console.log" append="off"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:58:59.375562 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Preparing to wait for external event network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838288422',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838288422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-volume-backed-server-838288422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMdreGe7raEJxhXV2aosTwZCvTUVTnfbNklxU4eKBx4C7OtXqZoeFM7gEgmzht+nYShKaRoVI8267zysRujsv19ybzI3drTp9uKSqvvY8sLYMh322F5Fb7uL7cWOZXttA==',key_name='tempest-keypair-1282475371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-uxi41twm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=5f20da65-2d84-4541-9190-ea4e4da46e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:58:59.377632 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:58:59.377955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.378201 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:59.378469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:58:59.379262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.379614 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb38320d-42ce-5069-9c7f-14b30db414bd', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:59.381195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:59.381351 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.383115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.383251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aece55f-3b, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:59.383552 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6aece55f-3b, col_values=(('qos', UUID('681ab4e9-0f5e-47ee-b09b-96b55f585893')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:59.383702 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6aece55f-3b, col_values=(('external_ids', {'iface-id': '6aece55f-3b8d-4753-a7e7-0fb9cd5d3679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:7a:6b', 'vm-uuid': '5f20da65-2d84-4541-9190-ea4e4da46e0b'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:58:59.384564 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.385795 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:58:59.390228 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:58:59.391181 np0000003683 nova-compute[98991]: INFO os_vif [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b')
Jun 26 02:58:59.408235 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:58:59.412513 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:59.420259 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:58:59.426891 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.434743 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.439783 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.450432 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.450801 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.455491 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.455660 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:59.491789 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.40.100,3260]
Jun 26 02:58:59.491789 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.40.100,3260] successful.
Jun 26 02:58:59.491789 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.503311 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.503815 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.50.100,3260]
Jun 26 02:58:59.503815 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.50.100,3260] successful.
Jun 26 02:58:59.503815 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.508878 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.518952 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:59.519472 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:59.519876 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:59.520907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:58:59.521253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('11', '-', '-', 0) found on session 211 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:59.521371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:59.537613 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 211 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:59.537794 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.539795 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:58:59.539997 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:58:59.540177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:58:59.540177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:58:59.541046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('12', '-', '-', 0) found on session 212 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:58:59.541180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:58:59.555399 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 212 and hctl ['12', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:58:59.635997 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updated VIF entry in instance network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:58:59.636169 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:58:59.740927 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:58:59.741126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:58:59.878912 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:58:59.980678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:58:59.981585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.069295 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.069801 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:59:00.075259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.139168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-75534d55-5330-426e-a4e6-9280a390bac1 req-28fc5463-a440-468c-a740-2d345a8c1928 service nova] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:00.163748 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.164198 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.244025 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Detaching volume 3f584118-7789-4ceb-b29f-dcdd42b74f52
Jun 26 02:59:00.255696 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.256664 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 02:59:00.264281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.306086 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Attempting to driver detach volume 3f584118-7789-4ceb-b29f-dcdd42b74f52 from mountpoint /dev/vdb
Jun 26 02:59:00.314594 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found disk vdb by alias ua-3f584118-7789-4ceb-b29f-dcdd42b74f52 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:00.315734 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Found disk vdb by alias ua-3f584118-7789-4ceb-b29f-dcdd42b74f52 {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:00.315844 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Attempting to detach device vdb from instance 92ff8d21-f526-4702-b4ad-8693a8fd455a from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <alias name="ua-3f584118-7789-4ceb-b29f-dcdd42b74f52"/>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <serial>3f584118-7789-4ceb-b29f-dcdd42b74f52</serial>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:00.316096 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:00.321652 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully detached device vdb from instance 92ff8d21-f526-4702-b4ad-8693a8fd455a from the persistent domain config.
Jun 26 02:59:00.321785 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] (1/8): Attempting to detach device vdb with device alias ua-3f584118-7789-4ceb-b29f-dcdd42b74f52 from instance 92ff8d21-f526-4702-b4ad-8693a8fd455a from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <alias name="ua-3f584118-7789-4ceb-b29f-dcdd42b74f52"/>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-5"/>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <serial>3f584118-7789-4ceb-b29f-dcdd42b74f52</serial>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:00.322061 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:00.365332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.365846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.454407 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.459898 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:59:00.460899 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:00.508934 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:00.509277 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50797MB free_disk=71.65913391113281GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 02:59:00.509438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:00.509675 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:00.554470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 212 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:00.554996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:59:00.797632 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:00.797773 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing instance network info cache due to event network-changed-1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:59:00.797996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] Acquiring lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:00.798073 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] Acquired lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:00.798237 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Refreshing network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:59:00.801616 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442740.8012588, 92ff8d21-f526-4702-b4ad-8693a8fd455a => ua-3f584118-7789-4ceb-b29f-dcdd42b74f52> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:59:00.802143 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3f584118-7789-4ceb-b29f-dcdd42b74f52 for instance 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:59:00.804300 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully detached device vdb from instance 92ff8d21-f526-4702-b4ad-8693a8fd455a from the live domain config.
Jun 26 02:59:00.805396 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:59:00.805755 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:00.805922 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:00.911534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:00.911677 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:00.911823 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:e4:7a:6b, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:59:00.912343 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Using config drive
Jun 26 02:59:01.302629 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:01.335341 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:01.335622 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:01.398718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Found WWN 3300000004301479e for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:59:01.399087 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:01.400191 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.594s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:01.400988 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== connect_volume: return (4537ms) {'type': 'block', 'scsi_wwn': '3300000004301479e', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004301479e'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:01.401177 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004301479e', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004301479e'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:59:01.401624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f584118-7789-4ceb-b29f-dcdd42b74f52', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:59:01.401814 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:59:01.404104 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:59:01.404351 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:59:01.404553 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:59:01.417896 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]:     <volume>ae9dc947-c3b4-46be-bb51-232550f9759e</volume>
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:59:01.420944 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:59:01.428272 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'flavor' on Instance uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:01.430261 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52 (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:01.430490 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:01.430699 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '212')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:59:01.430853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '197')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:01.431838 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52', '198')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:01.433890 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c4efc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:59:01.434231 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Removing multipathed devices sdh, sdi {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:59:01.434573 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Flush multipath device 330000000458801e4 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:59:01.470462 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:01.516013 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:01.564259 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Creating config drive at /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/disk.config
Jun 26 02:59:01.565256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:59:01.565567 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:59:01.567968 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:59:01.571881 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplqzbirf1 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:01.595746 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:59:01.596292 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 92ff8d21-f526-4702-b4ad-8693a8fd455a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:59:01.597305 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:59:01.598122 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 93a2c213-03d0-4ecb-8d98-05705ea10619 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:59:01.598455 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:59:01.599225 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5f20da65-2d84-4541-9190-ea4e4da46e0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 02:59:01.599784 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 02:59:01.600126 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:59:00 up 45 min,  2 users,  load average: 3.02, 4.86, 4.72\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_884d962a595245afbe319c15ac2ccc1f': '1', 'io_workload': '1', 'num_proj_7b27156fe7ab4391b30a0b973577b79c': '1', 'num_proj_dc75731d341143958b1030ac806f2343': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 02:59:01.612727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.633717 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplqzbirf1" returned: 0 in 0.062s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:01.638894 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:01.651718 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.40.100,3260]
Jun 26 02:59:01.651718 np0000003683 nova-compute[98991]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.40.100,3260] successful.
Jun 26 02:59:01.651718 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.668844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.681934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.711748 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.50.100,3260]
Jun 26 02:59:01.711748 np0000003683 nova-compute[98991]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-3f584118-7789-4ceb-b29f-dcdd42b74f52, portal: 192.168.50.100,3260] successful.
Jun 26 02:59:01.711748 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.727802 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:01.728135 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:01.728271 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] <== disconnect_volume: return (922ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:01.728402 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:59:01.792540 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updated VIF entry in instance network info cache for port 1f456c56-73b6-4dfd-8216-a19cad2b6307. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:59:01.792829 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [{"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:01.831339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:01.831621 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:01.838253 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Detaching volume 2156e511-9dd8-4946-9892-c79f06d638dd
Jun 26 02:59:01.875993 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Attempting to driver detach volume 2156e511-9dd8-4946-9892-c79f06d638dd from mountpoint /dev/vdb
Jun 26 02:59:01.882316 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-2156e511-9dd8-4946-9892-c79f06d638dd {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:01.883520 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Found disk vdb by alias ua-2156e511-9dd8-4946-9892-c79f06d638dd {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:01.883661 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Attempting to detach device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <alias name="ua-2156e511-9dd8-4946-9892-c79f06d638dd"/>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <serial>2156e511-9dd8-4946-9892-c79f06d638dd</serial>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:01.883886 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:01.889419 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the persistent domain config.
Jun 26 02:59:01.889662 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] (1/8): Attempting to detach device vdb with device alias ua-2156e511-9dd8-4946-9892-c79f06d638dd from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <alias name="ua-2156e511-9dd8-4946-9892-c79f06d638dd"/>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <source dev="/dev/dm-0"/>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <serial>2156e511-9dd8-4946-9892-c79f06d638dd</serial>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:01.889934 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:01.934129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Attempting to attach volume ae9dc947-c3b4-46be-bb51-232550f9759e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98991) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] attach device xml: <disk type="block" device="disk">
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <alias name="ua-ae9dc947-c3b4-46be-bb51-232550f9759e"/>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <serial>ae9dc947-c3b4-46be-bb51-232550f9759e</serial>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="15728827-74bb-4468-9915-47686d0da4e1"/>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:01.935787 np0000003683 nova-compute[98991]:  {{(pid=98991) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 26 02:59:02.155284 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.188056 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.189759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.273005 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.296761 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-192036b2-e4f2-4634-a99b-c5e9891d18e5 req-6c516cde-5772-43a4-bc0d-b3a7b82864fa service nova] Releasing lock "refresh_cache-92ff8d21-f526-4702-b4ad-8693a8fd455a" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:02.316415 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'flavor' on Instance uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:02.334274 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:02.376795 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8bd39f97-0c7f-4182-bd75-9c9417a73b72 req-9f6f7209-1fae-4a10-8e98-6b1a5beb760e service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:02.378115 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8bd39f97-0c7f-4182-bd75-9c9417a73b72 req-9f6f7209-1fae-4a10-8e98-6b1a5beb760e service nova] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:02.378300 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8bd39f97-0c7f-4182-bd75-9c9417a73b72 req-9f6f7209-1fae-4a10-8e98-6b1a5beb760e service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:02.378468 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8bd39f97-0c7f-4182-bd75-9c9417a73b72 req-9f6f7209-1fae-4a10-8e98-6b1a5beb760e service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:02.378717 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8bd39f97-0c7f-4182-bd75-9c9417a73b72 req-9f6f7209-1fae-4a10-8e98-6b1a5beb760e service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Processing event network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:59:02.434417 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442742.4340158, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => ua-2156e511-9dd8-4946-9892-c79f06d638dd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:59:02.435451 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2156e511-9dd8-4946-9892-c79f06d638dd for instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:59:02.439505 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully detached device vdb from instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 from the live domain config.
Jun 26 02:59:02.443251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:59:02.443630 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:02.443852 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:02.444281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:02.444633 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2156e511-9dd8-4946-9892-c79f06d638dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:59:02.444775 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:59:02.456709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:02.475190 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:02.475557 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:02.475987 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '212')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:59:02.475987 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '208')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:02.476769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd', '207')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:02.477595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c57a2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:59:02.477805 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:59:02.478046 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Flush multipath device 3300000004d6038b7 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:59:02.511186 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:02.520696 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.524153 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.530624 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.547642 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:02.563229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:02.612004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:59:02.612350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:59:02.613266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:59:02.624619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:59:02.624810 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:59:02.638928 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.672709 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.40.100,3260]
Jun 26 02:59:02.672709 np0000003683 nova-compute[98991]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.40.100,3260] successful.
Jun 26 02:59:02.672709 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.688274 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.699973 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.731604 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.50.100,3260]
Jun 26 02:59:02.731604 np0000003683 nova-compute[98991]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-2156e511-9dd8-4946-9892-c79f06d638dd, portal: 192.168.50.100,3260] successful.
Jun 26 02:59:02.731604 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.746015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:02.746256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:02.746409 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] <== disconnect_volume: return (302ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:02.746557 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:59:02.841411 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 02:59:02.841758 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.332s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:02.842048 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:59:03.005175 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442743.0047088, 5f20da65-2d84-4541-9190-ea4e4da46e0b => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:03.005528 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] VM Started (Lifecycle Event)
Jun 26 02:59:03.006665 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:59:03.009739 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:59:03.012643 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance spawned successfully.
Jun 26 02:59:03.013093 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:59:03.296390 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'flavor' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:03.324940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d38d9cc-61f4-487a-8293-5634f7ff4dd0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.584s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:03.508259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:03.510186 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:59:03.520251 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:03.520634 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:03.521200 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:03.521379 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:03.522707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:03.522805 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:04.014760 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:59:04.015144 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442744.0148423, 5f20da65-2d84-4541-9190-ea4e4da46e0b => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:04.015144 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] VM Paused (Lifecycle Event)
Jun 26 02:59:04.029354 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Took 8.72 seconds to spawn the instance on the hypervisor.
Jun 26 02:59:04.029696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:04.302327 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-daaba0ea-7c65-446d-914c-d4a90e745fbb tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.967s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:04.386033 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:04.427793 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:04.428011 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:04.428183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:04.428293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:04.428625 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] No waiting events found dispatching network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:04.428742 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3221861f-2c53-4d18-8c35-74652b829d6f req-9a92fad0-c42d-4367-ad49-54b84d7a4465 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received unexpected event network-vif-plugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 for instance with vm_state active and task_state None.
Jun 26 02:59:04.519343 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:04.521380 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442744.5211582, 5f20da65-2d84-4541-9190-ea4e4da46e0b => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:04.521488 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] VM Resumed (Lifecycle Event)
Jun 26 02:59:04.538290 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Took 15.73 seconds to build instance.
Jun 26 02:59:04.580157 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:04.582495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:04.582495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:04.582495 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No VIF found with MAC fa:16:3e:2f:d2:c8, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:59:05.023600 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:05.025657 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:59:05.039522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.241s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:05.173711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:05.173942 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:05.174231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:05.174423 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:05.174604 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:05.176611 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Terminating instance
Jun 26 02:59:05.625920 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-changed-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:05.626056 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Refreshing instance network info cache due to event network-changed-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:59:05.626832 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] Acquiring lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:05.626930 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] Acquired lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:05.627051 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Refreshing network info cache for port 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:59:05.679915 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:59:05.699647 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:05.700210 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:05.721800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:05.735613 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:05.755814 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:05.841865 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:05.842164 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:05.842383 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:05.842617 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:05.842830 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:59:05.848199 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:05.848641 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:05.848799 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:05.848935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:05.849079 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:05.849415 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-21c83d86-f89c-4509-9f73-48aae42cbe9c req-d41de339-a88c-427a-a000-1a5e2f081579 service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:06.017580 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999675835999824 future=<Future at 0x72e27c1f2ba0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:06.017993 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99921210399998 future=<Future at 0x72e27c1f2ba0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:06.018193 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998951759000192 future=<Future at 0x72e27c1f2ba0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:06.020195 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Instance destroyed successfully.
Jun 26 02:59:06.020620 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lazy-loading 'resources' on Instance uuid 92ff8d21-f526-4702-b4ad-8693a8fd455a {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:06.131803 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:06.134914 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-52174e56-9b7b-4b67-aa2f-017643e3c73c tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.986s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:06.431867 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:06.522993 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1721270623',display_name='tempest-TestMinimumBasicScenario-server-1721270623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testminimumbasicscenario-server-1721270623',id=72,image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILuPPd6F5qnyx8tqI7g3bGak8B3a1e+yxOsHJ503adSv7aZ3beMGVFfEH1U53ZMDFhibVJUuhATiEyWFCfzPmGzeEcMTLqJ3LKH8qZzPg2+W7eH1RKGA3YH3CYbWWyJhA==',key_name='tempest-TestMinimumBasicScenario-1072256690',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:57:45Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b27156fe7ab4391b30a0b973577b79c',ramdisk_id='',reservation_id='r-mk365x2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22db2ce2-a67b-415e-986f-b8fb1e5ad721',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-325636508',owner_user_name='tempest-TestMinimumBasicScenario-325636508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:58:22Z,user_data=None,user_id='5c6f720766e94dd0ba2fab81ef66906f',uuid=92ff8d21-f526-4702-b4ad-8693a8fd455a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:59:06.523192 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converting VIF {"id": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "address": "fa:16:3e:8a:18:fc", "network": {"id": "b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-299973356-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7b27156fe7ab4391b30a0b973577b79c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f456c56-73", "ovs_interfaceid": "1f456c56-73b6-4dfd-8216-a19cad2b6307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:59:06.523753 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:59:06.524056 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:59:06.525707 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:06.525999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f456c56-73, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:06.527016 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:06.527838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:06.528583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:06.528748 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce5187d3-1eb9-4054-a570-52e9235836bb) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:06.529144 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:06.529583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:06.530384 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:06.532522 np0000003683 nova-compute[98991]: INFO os_vif [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:18:fc,bridge_name='br-int',has_traffic_filtering=True,id=1f456c56-73b6-4dfd-8216-a19cad2b6307,network=Network(b8f7fcae-3ed3-4f7a-8d72-9574e88d82e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f456c56-73')
Jun 26 02:59:06.533116 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Deleting instance files /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a_del
Jun 26 02:59:06.533879 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Deletion of /opt/stack/data/nova/instances/92ff8d21-f526-4702-b4ad-8693a8fd455a_del complete
Jun 26 02:59:06.566201 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updated VIF entry in instance network info cache for port 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:59:06.566483 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updating instance_info_cache with network_info: [{"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:07.040257 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 26 02:59:07.040990 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:59:07.041161 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:59:07.041249 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:59:07.041429 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:07.068504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-12c0ca30-5582-4289-b70d-3e06e9b459ab req-a5497d94-f9d8-4e8b-90c8-1989321755de service nova] Releasing lock "refresh_cache-5f20da65-2d84-4541-9190-ea4e4da46e0b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:07.101547 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:07.101735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:07.135747 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:07.345280 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:07.345698 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:59:07.458637 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:07.604245 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Detaching volume ae9dc947-c3b4-46be-bb51-232550f9759e
Jun 26 02:59:07.639515 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Attempting to driver detach volume ae9dc947-c3b4-46be-bb51-232550f9759e from mountpoint /dev/vdb
Jun 26 02:59:07.665259 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '93a2c213-03d0-4ecb-8d98-05705ea10619', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'serial': 'ae9dc947-c3b4-46be-bb51-232550f9759e'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:59:07.668805 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Found disk vdb by alias ua-ae9dc947-c3b4-46be-bb51-232550f9759e {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:07.669918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Found disk vdb by alias ua-ae9dc947-c3b4-46be-bb51-232550f9759e {{(pid=98991) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 26 02:59:07.670087 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Attempting to detach device vdb from instance 93a2c213-03d0-4ecb-8d98-05705ea10619 from the persistent domain config. {{(pid=98991) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <alias name="ua-ae9dc947-c3b4-46be-bb51-232550f9759e"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <serial>ae9dc947-c3b4-46be-bb51-232550f9759e</serial>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="15728827-74bb-4468-9915-47686d0da4e1"/>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:07.670346 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:07.675598 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully detached device vdb from instance 93a2c213-03d0-4ecb-8d98-05705ea10619 from the persistent domain config.
Jun 26 02:59:07.675718 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] (1/8): Attempting to detach device vdb with device alias ua-ae9dc947-c3b4-46be-bb51-232550f9759e from instance 93a2c213-03d0-4ecb-8d98-05705ea10619 from the live domain config. {{(pid=98991) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.guest [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] detach device xml: <disk type="block" device="disk">
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <alias name="ua-ae9dc947-c3b4-46be-bb51-232550f9759e"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <target dev="vdb" bus="virtio"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <serial>ae9dc947-c3b4-46be-bb51-232550f9759e</serial>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   <encryption format="luks">
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:     <secret type="passphrase" uuid="15728827-74bb-4468-9915-47686d0da4e1"/>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:   </encryption>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]: </disk>
Jun 26 02:59:07.675970 np0000003683 nova-compute[98991]:  {{(pid=98991) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 26 02:59:07.859579 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:07.900384 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:07.900582 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] Acquiring lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:07.900774 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:07.900874 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:07.901007 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] No waiting events found dispatching network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:07.901121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-unplugged-1f456c56-73b6-4dfd-8216-a19cad2b6307 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:07.901223 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e8117882-2243-4e8d-b483-4e8e1f8e6bf2 req-ae5b8fa1-fcb3-43b6-8a5f-6002f5af39bd service nova] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Received event network-vif-deleted-1f456c56-73b6-4dfd-8216-a19cad2b6307 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:08.140130 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Received event <DeviceRemovedEvent: 1782442748.1397967, 93a2c213-03d0-4ecb-8d98-05705ea10619 => ua-ae9dc947-c3b4-46be-bb51-232550f9759e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98991) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 26 02:59:08.141406 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ae9dc947-c3b4-46be-bb51-232550f9759e for instance 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 26 02:59:08.143576 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully detached device vdb from instance 93a2c213-03d0-4ecb-8d98-05705ea10619 from the live domain config.
Jun 26 02:59:08.145808 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 02:59:08.146115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:08.146257 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:08.146592 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:08.146895 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae9dc947-c3b4-46be-bb51-232550f9759e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 02:59:08.147050 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 02:59:08.170499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:08.170499 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:08.170499 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:08.170499 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:08.170499 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:08.170730 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:08.170730 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:08.170730 np0000003683 nova-compute[98991]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:08.170730 np0000003683 nova-compute[98991]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e (non-flash)
Jun 26 02:59:08.170730 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:08.170844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '212')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 02:59:08.170976 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '211')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:08.171721 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e', '212')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 02:59:08.172365 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3cef20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 02:59:08.172569 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Removing multipathed devices sdg, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 02:59:08.172787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flush multipath device 3300000004301479e {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 02:59:08.200556 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:08.250883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 02:59:08.288814 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 02:59:08.289027 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 02:59:08.289842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 02:59:08.300651 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 02:59:08.300840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 02:59:08.311273 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.351841 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.40.100,3260]
Jun 26 02:59:08.351841 np0000003683 nova-compute[98991]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.40.100,3260] successful.
Jun 26 02:59:08.351841 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.361521 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Took 1.32 seconds to deallocate network for instance.
Jun 26 02:59:08.367752 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.380555 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.417785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.50.100,3260]
Jun 26 02:59:08.417785 np0000003683 nova-compute[98991]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-ae9dc947-c3b4-46be-bb51-232550f9759e, portal: 192.168.50.100,3260] successful.
Jun 26 02:59:08.417785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.430726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:08.431690 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:08.431784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== disconnect_volume: return (285ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:08.431899 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 02:59:08.869741 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:08.869931 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:08.977719 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'flavor' on Instance uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:09.090707 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:09.090946 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:09.593261 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:09.983003 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6e310351-4290-4bf4-9a16-a79fc2db36b8 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.881s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:10.101686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.232s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:10.147578 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Deleted allocations for instance 92ff8d21-f526-4702-b4ad-8693a8fd455a
Jun 26 02:59:10.350686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:10.350817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:10.351024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:10.351170 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:10.351290 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:10.353191 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Terminating instance
Jun 26 02:59:10.856080 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:59:10.884407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:10.887366 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:10.908509 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:10.908965 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:10.927872 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.028008 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:11.028453 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:11.028679 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:11.028840 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:11.029027 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] No waiting events found dispatching network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:11.029210 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-8c73c77d-b91f-4344-8ff7-091f6de6426e req-50ede1b3-9266-4299-9bbb-0c62d41750da service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:11.155318 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c51e6865-93cf-465e-8794-1d802623b7f0 tempest-TestMinimumBasicScenario-325636508 tempest-TestMinimumBasicScenario-325636508-project-member] Lock "92ff8d21-f526-4702-b4ad-8693a8fd455a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.981s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:11.173462 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999638788000084 future=<Future at 0x72e29c3380b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:11.175966 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Instance destroyed successfully.
Jun 26 02:59:11.176649 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'resources' on Instance uuid 93a2c213-03d0-4ecb-8d98-05705ea10619 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:11.530225 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.678807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1575659100',display_name='tempest-TestEncryptedCinderVolumes-server-1575659100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1575659100',id=73,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTAm5aGTCFgeEn6rfn0jybiJZD9JwcLQx8TvNcY06JikUKCzkpxbQh8mCMUG9sB9ZqIVo3SyhDxYW3+pCoPPVVoCjLDYOH0f8KHXbpqbELLoDAt/TXmKWX9vSP8+N0Lw==',key_name='tempest-keypair-990125776',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:58:15Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-uhpu08nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=93a2c213-03d0-4ecb-8d98-05705ea10619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:59:11.678999 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "address": "fa:16:3e:2f:d2:c8", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f968dc3-43", "ovs_interfaceid": "0f968dc3-43a3-476c-ad97-a8144fbc7281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:59:11.679486 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:59:11.679702 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:59:11.680490 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.680670 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f968dc3-43, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:11.681598 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.682567 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:11.683612 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.684137 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.684309 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bc0a62f-d869-4a81-ad19-9be24cef2f51) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:11.684800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.685399 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:11.686262 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:11.688212 np0000003683 nova-compute[98991]: INFO os_vif [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:d2:c8,bridge_name='br-int',has_traffic_filtering=True,id=0f968dc3-43a3-476c-ad97-a8144fbc7281,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f968dc3-43')
Jun 26 02:59:11.688530 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Deleting instance files /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619_del
Jun 26 02:59:11.689401 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Deletion of /opt/stack/data/nova/instances/93a2c213-03d0-4ecb-8d98-05705ea10619_del complete
Jun 26 02:59:12.196077 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Took 1.34 seconds to destroy the instance on the hypervisor.
Jun 26 02:59:12.197121 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:59:12.197331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:59:12.197490 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:59:12.197685 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:12.258863 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:12.326591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:12.326591 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:12.326961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:12.326961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:12.326961 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:12.329836 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Terminating instance
Jun 26 02:59:12.462293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:12.769883 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7dc8367b-ee50-4798-b4f3-11eb700cb26b req-11a8ffde-5bb5-4232-8de4-dff90b2da6cc service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-deleted-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:12.770294 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-7dc8367b-ee50-4798-b4f3-11eb700cb26b req-11a8ffde-5bb5-4232-8de4-dff90b2da6cc service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Neutron deleted interface 0f968dc3-43a3-476c-ad97-a8144fbc7281; detaching it from the instance and deleting it from the info cache
Jun 26 02:59:12.772005 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7dc8367b-ee50-4798-b4f3-11eb700cb26b req-11a8ffde-5bb5-4232-8de4-dff90b2da6cc service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Detach interface failed, port_id=0f968dc3-43a3-476c-ad97-a8144fbc7281, reason: Instance 93a2c213-03d0-4ecb-8d98-05705ea10619 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:59:12.833848 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 02:59:12.854155 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:12.857537 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:12.878312 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:12.880810 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:12.901084 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.101971 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:13.102208 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] Acquiring lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:13.102429 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:13.102639 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:13.102859 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] No waiting events found dispatching network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:13.102949 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5e1c33fc-0c43-454b-ba87-d4fb5c5e9dba req-6082ebc1-ab6a-42a6-b801-7efa33cc8f5f service nova] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Received event network-vif-unplugged-0f968dc3-43a3-476c-ad97-a8144fbc7281 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:13.131271 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:13.131438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:13.131638 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:13.131740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:13.131858 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] No waiting events found dispatching network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:13.132015 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3a8f46a5-1371-4cb6-9ba9-9f39b7ec23f1 req-288640d9-0493-4df4-ba99-3341b5308ac0 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:13.170789 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999679492999803 future=<Future at 0x72e29e7ea630 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:13.173532 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Instance destroyed successfully.
Jun 26 02:59:13.174025 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lazy-loading 'resources' on Instance uuid 0534b0e4-b1ef-4546-9061-731ba488cdf9 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:13.209217 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:13.679827 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380292941',display_name='tempest-SnapshotDataIntegrityTests-server-380292941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-snapshotdataintegritytests-server-380292941',id=70,image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIWGDaoof8v+p0Ju/sR9snJLSfs6hTdmACs2bsn6r93GeZMXoQmAbWqPS8+uBan0Pa/JfO0rVARRGYymODpnEBetL8j/b5mNkYUW5P8wsTxp1raxh8ur2c9znT2TJvFlA==',key_name='tempest-keypair-1245171642',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:57:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='884d962a595245afbe319c15ac2ccc1f',ramdisk_id='',reservation_id='r-ygx8tjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0918cd-17b7-4dc6-8a46-002286996c07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1423257265',owner_user_name='tempest-SnapshotDataIntegrityTests-1423257265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4eb6a96c0c94530a4b3a32ab643cc10',uuid=0534b0e4-b1ef-4546-9061-731ba488cdf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 02:59:13.680015 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converting VIF {"id": "72204700-32a0-40e5-a89d-3bbda357e9a5", "address": "fa:16:3e:1f:2e:0d", "network": {"id": "1538eb74-040e-431e-b0ba-755e36364717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2139985502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "884d962a595245afbe319c15ac2ccc1f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72204700-32", "ovs_interfaceid": "72204700-32a0-40e5-a89d-3bbda357e9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:59:13.680456 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:59:13.680700 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 02:59:13.682669 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.682946 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72204700-32, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:13.688488 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.689462 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:13.709532 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.712409 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Took 1.51 seconds to deallocate network for instance.
Jun 26 02:59:13.712755 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.714827 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.715718 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19110a56-24aa-48cc-be52-edb2ab0e576b) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:13.719303 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:13.720100 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:13.724855 np0000003683 nova-compute[98991]: INFO os_vif [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2e:0d,bridge_name='br-int',has_traffic_filtering=True,id=72204700-32a0-40e5-a89d-3bbda357e9a5,network=Network(1538eb74-040e-431e-b0ba-755e36364717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72204700-32')
Jun 26 02:59:13.725136 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Deleting instance files /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9_del
Jun 26 02:59:13.725830 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Deletion of /opt/stack/data/nova/instances/0534b0e4-b1ef-4546-9061-731ba488cdf9_del complete
Jun 26 02:59:14.221664 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:14.223352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:14.231170 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Took 1.40 seconds to destroy the instance on the hypervisor.
Jun 26 02:59:14.231682 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 02:59:14.231833 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 02:59:14.231923 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 02:59:14.232198 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:14.361865 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:14.445719 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:14.445985 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:14.822918 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2a098b7-3aa6-4894-9fb6-4e7d7859cd23 req-bd91b1c9-a46f-46f2-adeb-a5cc9e72ed57 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-deleted-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:14.823078 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-f2a098b7-3aa6-4894-9fb6-4e7d7859cd23 req-bd91b1c9-a46f-46f2-adeb-a5cc9e72ed57 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Neutron deleted interface 72204700-32a0-40e5-a89d-3bbda357e9a5; detaching it from the instance and deleting it from the info cache
Jun 26 02:59:14.824601 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f2a098b7-3aa6-4894-9fb6-4e7d7859cd23 req-bd91b1c9-a46f-46f2-adeb-a5cc9e72ed57 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Detach interface failed, port_id=72204700-32a0-40e5-a89d-3bbda357e9a5, reason: Instance 0534b0e4-b1ef-4546-9061-731ba488cdf9 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 02:59:14.948554 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:15.201511 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:15.201932 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] Acquiring lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:15.202161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:15.202583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:15.202814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] No waiting events found dispatching network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:15.202814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ac573e15-ff05-4d56-8244-655f905a242c req-588e25e2-5176-4bdf-93ad-13b355374826 service nova] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Received event network-vif-unplugged-72204700-32a0-40e5-a89d-3bbda357e9a5 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 02:59:15.217665 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:15.455846 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:15.507626 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deleted allocations for instance 93a2c213-03d0-4ecb-8d98-05705ea10619
Jun 26 02:59:15.720388 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Took 1.49 seconds to deallocate network for instance.
Jun 26 02:59:15.794509 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:16.237570 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:16.238014 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:16.372898 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:16.372898 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:16.515886 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-aaad1d9d-d811-4d14-b0db-fb3f18f343ae tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "93a2c213-03d0-4ecb-8d98-05705ea10619" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.165s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:16.874937 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:17.380878 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.143s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:17.428802 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Deleted allocations for instance 0534b0e4-b1ef-4546-9061-731ba488cdf9
Jun 26 02:59:17.462931 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:18.437121 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-5b24679f-2725-4288-ab94-b9156c737698 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Lock "0534b0e4-b1ef-4546-9061-731ba488cdf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.111s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:18.734546 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:19.254580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:20.641357 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:21.017614 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00043078799990325933 future=<Future at 0x72e27c1f2ba0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:21.017758 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:21.017839 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.155198730000393 future=<Future at 0x72e29c3380b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:21.018538 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=5.155098243000339 future=<Future at 0x72e29c3380b0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:21.018960 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442746.0170634, 92ff8d21-f526-4702-b4ad-8693a8fd455a => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:21.019219 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] VM Stopped (Lifecycle Event)
Jun 26 02:59:21.374415 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:21.521675 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 92ff8d21-f526-4702-b4ad-8693a8fd455a] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:22.464548 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:22.987125 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:23.144213 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:23.736840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:24.649319 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:26.173544 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003781430000344699 future=<Future at 0x72e29c3380b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:26.174272 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442751.1729403, 93a2c213-03d0-4ecb-8d98-05705ea10619 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:26.174459 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:26.174673 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] VM Stopped (Lifecycle Event)
Jun 26 02:59:26.175890 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.9945689989999664 future=<Future at 0x72e29e7ea630 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:26.176070 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.9943602909997935 future=<Future at 0x72e29e7ea630 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:26.677429 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d757a36f-6765-4322-a03a-3bbff8f4da2a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 93a2c213-03d0-4ecb-8d98-05705ea10619] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:27.466117 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:28.170859 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00038352000001395936 future=<Future at 0x72e29e7ea630 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:28.170983 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 02:59:28.171695 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442753.1703494, 0534b0e4-b1ef-4546-9061-731ba488cdf9 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:28.171913 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] VM Stopped (Lifecycle Event)
Jun 26 02:59:28.676642 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 0534b0e4-b1ef-4546-9061-731ba488cdf9] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:28.738115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:32.468056 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:33.738936 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:37.225864 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:37.226374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:37.469782 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:37.728258 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:59:38.296182 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:38.296573 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:38.300092 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:59:38.300237 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Claim successful on node np0000003683
Jun 26 02:59:38.740207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:39.447756 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:39.448374 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:39.950632 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:40.456755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:40.457437 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:59:40.962590 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:59:40.962880 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:59:40.963090 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:40.963286 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:41.032827 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '209bf2f2739a4be69e4ecbddb9411821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc75731d341143958b1030ac806f2343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:59:41.451617 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Successfully created port: 5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:59:41.465893 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:59:41.902577 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Successfully updated port: 5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:59:41.954911 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-changed-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:41.955335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Refreshing instance network info cache due to event network-changed-5e9af8a0-f084-401e-af3c-549f6dd52757. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:59:41.955516 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] Acquiring lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:41.955651 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] Acquired lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:41.955800 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Refreshing network info cache for port 5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:59:41.969654 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:59:42.407975 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:42.459790 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:42.471510 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:42.475907 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Booting with volume f3763222-4f1e-4d3a-93b7-33dc24c162f9 at /dev/vda
Jun 26 02:59:42.512444 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:42.521608 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:59:42.526766 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:59:42.546408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:42.591806 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:59:42.592145 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:59:42.601066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:59:42.602126 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fee4:7a6b', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 02:59:42.602248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:59:42.602367 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:59:42.602619 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:42.602838 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updating existing volume attachment record: 3b62baa6-e1fa-4e7a-9862-05c756f0f463 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:59:42.676699 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:43.179366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b66ff956-b4b2-458a-bf9a-f7556df92198 req-1aa3b2da-5215-4664-a014-4a049668588d service nova] Releasing lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:43.180137 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquired lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:43.180365 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:59:43.742115 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:43.744886 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:59:43.913039 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:44.043057 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updating instance_info_cache with network_info: [{"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:44.545059 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Releasing lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:44.545440 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance network_info: |[{"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:59:44.711616 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:59:44.713239 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:59:44.713578 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Creating image(s)
Jun 26 02:59:44.714076 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:59:44.714272 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Ensure instance console log exists: /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:59:44.714540 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:44.714901 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:44.715124 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:44.715876 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Start _get_guest_xml network_info=[{"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3b62baa6-e1fa-4e7a-9862-05c756f0f463', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '775de962-784d-4dfd-8d16-f80f6f622705', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'serial': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:59:44.721706 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:59:44.723218 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-29639793', uuid='775de962-784d-4dfd-8d16-f80f6f622705'), owner=OwnerMeta(userid='209bf2f2739a4be69e4ecbddb9411821', username='tempest-TestEncryptedCinderVolumes-1323610914-project-member', projectid='dc75731d341143958b1030ac806f2343', projectname='tempest-TestEncryptedCinderVolumes-1323610914'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442784.722799) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:59:44.724586 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:59:44.724964 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:59:44.726197 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:59:44.727081 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:59:44.727453 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:59:44.727740 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:59:44.727866 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:59:44.727962 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:59:44.728083 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:59:44.728164 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:59:44.728255 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:59:44.728401 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:59:44.728512 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:59:44.728622 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:59:44.728714 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:59:44.728826 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:59:44.741787 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:59:44.741787 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:44.741901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:44.742281 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:44.742638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:59:44.754158 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:44.754777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:44.755335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:44.755555 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:59:44.756114 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:44.756413 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:59:44.768351 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:59:44.768351 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:44.771839 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:59:44.771839 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9] added
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:44.781082 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:44.781356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:59:44.781429 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:59:44.781621 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9] added
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:44.785680 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:44.785888 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:59:44.786018 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:59:44.786204 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:59:45.782123 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:59:45.786594 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:59:45.795949 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:59:45.801785 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.809934 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.815914 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.826254 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.826254 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.826254 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:45.826411 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.826411 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.826411 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:45.831357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.831357 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.831357 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:45.831527 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.831527 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.831527 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:45.860015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.50.100,3260]
Jun 26 02:59:45.860015 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.50.100,3260] successful.
Jun 26 02:59:45.860015 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.873791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.880130 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.40.100,3260]
Jun 26 02:59:45.880130 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.40.100,3260] successful.
Jun 26 02:59:45.880130 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.889373 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:45.889855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:45.889953 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:59:45.890751 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('7', '-', '-', 0) found on session 216 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:59:45.891127 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:59:45.896759 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:45.910777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 216 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:45.914689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.914689 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.914689 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.914689 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.914689 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:45.914878 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.914878 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:45.914878 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.914878 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:45.914878 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:45.915959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:45.915959 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:59:45.916306 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('8', '-', '-', 0) found on session 217 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:59:45.916492 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:59:45.931762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 217 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:45.931762 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:59:46.644294 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:46.644486 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:46.908296 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 216 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:46.908723 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:59:47.147597 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 02:59:47.702136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:47.702365 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:47.706136 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 02:59:47.706299 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Claim successful on node np0000003683
Jun 26 02:59:47.771831 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Found WWN 330000000862ea2f8 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 02:59:47.772095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:47.773164 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000862ea2f8', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000862ea2f8'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:47.773277 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000862ea2f8', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000862ea2f8'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 02:59:47.803176 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '775de962-784d-4dfd-8d16-f80f6f622705', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'serial': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 02:59:47.803686 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 02:59:47.803924 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:59:47.804143 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]:     <volume>f3763222-4f1e-4d3a-93b7-33dc24c162f9</volume>
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]:   </usage>
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]: </secret>
Jun 26 02:59:47.820250 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 02:59:48.331547 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-29639793',display_name='tempest-TestEncryptedCinderVolumes-server-29639793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-29639793',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-wckxa42c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:59:42Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=775de962-784d-4dfd-8d16-f80f6f622705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 02:59:48.332121 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:59:48.332401 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:59:48.333363 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'pci_devices' on Instance uuid 775de962-784d-4dfd-8d16-f80f6f622705 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 02:59:48.744059 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] End _get_guest_xml xml=<domain type="qemu">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <uuid>775de962-784d-4dfd-8d16-f80f6f622705</uuid>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <name>instance-0000004c</name>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-29639793</nova:name>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:59:44</nova:creationTime>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:user uuid="209bf2f2739a4be69e4ecbddb9411821">tempest-TestEncryptedCinderVolumes-1323610914-project-member</nova:user>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:project uuid="dc75731d341143958b1030ac806f2343">tempest-TestEncryptedCinderVolumes-1323610914</nova:project>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <nova:port uuid="5e9af8a0-f084-401e-af3c-549f6dd52757">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <system>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="serial">775de962-784d-4dfd-8d16-f80f6f622705</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="uuid">775de962-784d-4dfd-8d16-f80f6f622705</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </system>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <os>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </os>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <features>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </features>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   <devices>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/disk.config"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <alias name="ua-f3763222-4f1e-4d3a-93b7-33dc24c162f9"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <serial>f3763222-4f1e-4d3a-93b7-33dc24c162f9</serial>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <encryption format="luks">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:         <secret type="passphrase" uuid="55dc6a2f-1352-4fd9-b6eb-62cecf600733"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       </encryption>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </disk>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:57:d9:93"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <target dev="tap5e9af8a0-f0"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </interface>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/console.log" append="off"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </serial>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <video>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </video>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </rng>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:   </devices>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]: </domain>
Jun 26 02:59:48.837211 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Preparing to wait for external event network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-29639793',display_name='tempest-TestEncryptedCinderVolumes-server-29639793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-29639793',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-wckxa42c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:59:42Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=775de962-784d-4dfd-8d16-f80f6f622705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 02:59:48.840052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.840561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:48.840561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 02:59:48.841236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.841403 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46ee4a9c-d110-5ad3-912a-7294b357eabd', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:48.842293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.843094 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:48.843689 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.845860 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.846021 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e9af8a0-f0, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:48.846335 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e9af8a0-f0, col_values=(('qos', UUID('e3e53d4c-11b7-47aa-bb09-5fdee185a1b4')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:48.846524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e9af8a0-f0, col_values=(('external_ids', {'iface-id': '5e9af8a0-f084-401e-af3c-549f6dd52757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d9:93', 'vm-uuid': '775de962-784d-4dfd-8d16-f80f6f622705'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 02:59:48.847546 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.848962 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 02:59:48.854293 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:48.855409 np0000003683 nova-compute[98991]: INFO os_vif [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0')
Jun 26 02:59:48.881140 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 02:59:48.881412 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 02:59:49.384425 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 02:59:49.891265 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.189s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:49.892155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 02:59:50.377500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:50.377500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 02:59:50.377500 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No VIF found with MAC fa:16:3e:57:d9:93, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 02:59:50.377500 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Using config drive
Jun 26 02:59:50.396725 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 02:59:50.398566 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 02:59:50.398821 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 02:59:50.399349 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:50.399571 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:50.468726 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 02:59:50.760746 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:50.880200 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:50.885317 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Successfully created port: f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 02:59:50.903090 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 02:59:51.027886 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Creating config drive at /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/disk.config
Jun 26 02:59:51.031261 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp620_gsy3 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:51.089346 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp620_gsy3" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 02:59:51.410489 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Booting with volume snapshot 679032da-964d-4421-bcbe-d4c4eafc1630 at /dev/vda
Jun 26 02:59:51.470895 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Successfully updated port: f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 02:59:51.526445 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-changed-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:51.526841 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Refreshing instance network info cache due to event network-changed-f19351a2-6e70-4c77-9b6c-f925cb370471. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:59:51.527086 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] Acquiring lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:51.527185 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] Acquired lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:51.527364 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Refreshing network info cache for port f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:59:51.536744 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.562001 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.564693 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.675279 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.756914 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a20993bf-ab7d-4fae-8ebc-f1d68f79eae3 req-4d697d23-2879-46d9-9c14-4be86db4e13a service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:51.757190 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a20993bf-ab7d-4fae-8ebc-f1d68f79eae3 req-4d697d23-2879-46d9-9c14-4be86db4e13a service nova] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:51.757467 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a20993bf-ab7d-4fae-8ebc-f1d68f79eae3 req-4d697d23-2879-46d9-9c14-4be86db4e13a service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:51.757618 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a20993bf-ab7d-4fae-8ebc-f1d68f79eae3 req-4d697d23-2879-46d9-9c14-4be86db4e13a service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:51.758414 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a20993bf-ab7d-4fae-8ebc-f1d68f79eae3 req-4d697d23-2879-46d9-9c14-4be86db4e13a service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Processing event network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 02:59:51.926402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.929027 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.947052 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:51.974114 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:52.029268 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:52.106317 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:59:52.266067 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:52.474617 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:52.768236 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-5f3fbfbb-9b37-4c73-934d-d3a602091fea req-990a2d81-a0b8-498a-a89b-99e3bf23edd8 service nova] Releasing lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:52.768513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:52.768687 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 02:59:53.293526 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 02:59:53.294732 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442793.2943404, 775de962-784d-4dfd-8d16-f80f6f622705 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:53.295426 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] VM Started (Lifecycle Event)
Jun 26 02:59:53.297904 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 02:59:53.301437 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance spawned successfully.
Jun 26 02:59:53.301842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 02:59:53.337137 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 02:59:53.519298 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:53.663830 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updating instance_info_cache with network_info: [{"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:53.798577 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:53.801106 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:59:53.809156 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.809310 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.809740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.810020 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.810358 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.810691 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 02:59:53.835709 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:53.836094 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:53.836295 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:53.836532 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:53.836705 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] No waiting events found dispatching network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 02:59:53.836866 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-36c5cc42-183e-494e-8641-f4026a92cb95 req-c78ae67c-756c-4922-b27c-480b918eae91 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received unexpected event network-vif-plugged-5e9af8a0-f084-401e-af3c-549f6dd52757 for instance with vm_state building and task_state spawning.
Jun 26 02:59:53.851447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:54.166466 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:54.166466 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance network_info: |[{"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 02:59:54.303383 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 02:59:54.303680 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442794.303471, 775de962-784d-4dfd-8d16-f80f6f622705 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:54.303801 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] VM Paused (Lifecycle Event)
Jun 26 02:59:54.317777 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Took 9.61 seconds to spawn the instance on the hypervisor.
Jun 26 02:59:54.318143 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:54.806576 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:54.811060 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442794.808966, 775de962-784d-4dfd-8d16-f80f6f622705 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 02:59:54.811060 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] VM Resumed (Lifecycle Event)
Jun 26 02:59:54.830164 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Took 16.60 seconds to build instance.
Jun 26 02:59:54.981977 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:54.999196 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 02:59:55.029069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 02:59:55.088955 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 02:59:55.089421 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 02:59:55.101968 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 02:59:55.104209 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fee4:7a6b', 'fe80::d4b5:11ff:fee7:5f60', 'fe80::fc16:3eff:fe57:d993', 'fe80::a87e:a5ff:fe85:a081'] 
Jun 26 02:59:55.104209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 02:59:55.104209 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 02:59:55.104209 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 02:59:55.104494 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updating existing volume attachment record: d3fe39e3-65f5-4dca-8fb2-61730b361c3d {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 02:59:55.312814 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 02:59:55.318857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 02:59:55.332103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e40c57c6-26d6-444f-aadc-930c7803ef4f tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.106s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:56.344664 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:56.345302 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:59:56.437685 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-changed-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 02:59:56.437685 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Refreshing instance network info cache due to event network-changed-5e9af8a0-f084-401e-af3c-549f6dd52757. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 02:59:56.437685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] Acquiring lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 02:59:56.437685 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] Acquired lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 02:59:56.437685 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Refreshing network info cache for port 5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 02:59:56.942881 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:57.236996 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 02:59:57.238497 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 02:59:57.238497 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Creating image(s)
Jun 26 02:59:57.238820 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 02:59:57.238966 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 02:59:57.239208 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:57.239338 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:57.239451 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:57.240504 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Start _get_guest_xml network_info=[{"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-06-26T02:59:43Z,direct_url=<?>,disk_format='raw',id=14434e37-b0e6-4b6e-b174-1f847430ddd2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1465458128',owner='05570fa2a3404351b9fa2350a3ad7449',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-06-26T02:59:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd3fe39e3-65f5-4dca-8fb2-61730b361c3d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ca2c5495-7eb1-48c7-ad4e-dd107d21e234', 'attached_at': '', 'detached_at': '', 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'serial': '67b4244b-cfa3-4d57-bcae-1e03acad5e23'}, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 02:59:57.243009 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 02:59:57.244199 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999', uuid='ca2c5495-7eb1-48c7-ad4e-dd107d21e234'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='14434e37-b0e6-4b6e-b174-1f847430ddd2', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442797.2438684) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 02:59:57.246493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 02:59:57.246493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 02:59:57.246830 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 02:59:57.247118 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 02:59:57.249128 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 02:59:57.249625 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-06-26T02:59:43Z,direct_url=<?>,disk_format='raw',id=14434e37-b0e6-4b6e-b174-1f847430ddd2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1465458128',owner='05570fa2a3404351b9fa2350a3ad7449',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-06-26T02:59:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 02:59:57.250004 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 02:59:57.250211 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 02:59:57.250461 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 02:59:57.250698 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 02:59:57.250919 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 02:59:57.251221 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 02:59:57.251486 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 02:59:57.251738 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 02:59:57.251929 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 02:59:57.252117 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 02:59:57.263461 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 02:59:57.263609 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 02:59:57.263863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:57.264602 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:57.264960 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 02:59:57.277927 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:57.278560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 02:59:57.279188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:57.279423 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:59:57.279782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 02:59:57.280027 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:59:57.284456 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 02:59:57.293508 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:59:57.293508 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:57.299991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 02:59:57.299991 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23] added
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:57.306227 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:57.306566 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:59:57.307229 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:59:57.307229 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23] added
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 02:59:57.314267 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:57.315328 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 02:59:57.315328 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 02:59:57.315328 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 02:59:57.451503 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updated VIF entry in instance network info cache for port 5e9af8a0-f084-401e-af3c-549f6dd52757. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 02:59:57.451503 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updating instance_info_cache with network_info: [{"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 02:59:57.475769 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:57.954026 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-194df095-2475-4b6c-9b3a-b70c4d516078 req-7fc71445-3447-4e02-a267-d6d09a5a5edc service nova] Releasing lock "refresh_cache-775de962-784d-4dfd-8d16-f80f6f622705" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 02:59:58.307381 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 02:59:58.315288 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:59:58.322343 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 02:59:58.332015 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.338640 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.344076 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:58.344340 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 02:59:58.344681 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 02:59:58.346364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.354116 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.354371 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.363588 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.363842 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:58.386094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.50.100,3260]
Jun 26 02:59:58.386094 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.50.100,3260] successful.
Jun 26 02:59:58.386094 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.399620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.407665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.40.100,3260]
Jun 26 02:59:58.407665 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.40.100,3260] successful.
Jun 26 02:59:58.407665 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.417649 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.417902 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:58.418115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:58.418504 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:59:58.419100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('12', '-', '-', 0) found on session 219 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:59:58.419258 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:59:58.420990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 02:59:58.439179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 219 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:58.439179 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.445864 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 02:59:58.446256 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 02:59:58.446507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 02:59:58.446507 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 02:59:58.447401 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('13', '-', '-', 0) found on session 220 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 02:59:58.447526 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 02:59:58.464175 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 220 and hctl ['13', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:58.852449 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 02:59:59.343785 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 02:59:59.464740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 220 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 02:59:59.465353 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 02:59:59.849126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 02:59:59.849298 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 02:59:59.849450 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 02:59:59.849624 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:00:00.298747 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000ae7175ba for multipath device dm-4 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:00:00.299137 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:00.299378 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000ae7175ba', 'path': '/dev/dm-4', 'multipath_id': '330000000ae7175ba'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:00.299619 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ae7175ba', 'path': '/dev/dm-4', 'multipath_id': '330000000ae7175ba'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:00:00.806127 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-image-snapshot-server-1004091999',id=77,image_ref='14434e37-b0e6-4b6e-b174-1f847430ddd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY7FLe7+zqiVra5Wx1T6VS2fCCZLGZIE2hv+5PC/+wnicDr5/+wAucHtE94AZ+Gxh016m1CdBzgcfXFNCv05LdUgLn7uG05nyiMq47RYe+PcIO+XiSZjRv5wMHYmIjj4w==',key_name='tempest-keypair-485424707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-1m07i0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1425057934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=ca2c5495-7eb1-48c7-ad4e-dd107d21e234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:00:00.806781 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:00.807087 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:00.807769 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2c5495-7eb1-48c7-ad4e-dd107d21e234 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:00.872941 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:00:00.874570 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:00:00.876173 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:00:00.876945 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:00:00.927501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:00:00.927846 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=50880MB free_disk=71.7030029296875GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:00:00.928055 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:00.928284 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <uuid>ca2c5495-7eb1-48c7-ad4e-dd107d21e234</uuid>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <name>instance-0000004d</name>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1004091999</nova:name>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 02:59:57</nova:creationTime>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:diskFormat>raw</nova:diskFormat>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="img_bdm_v2">True</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:root type="image" uuid=""/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         <nova:port uuid="f19351a2-6e70-4c77-9b6c-f925cb370471">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="serial">ca2c5495-7eb1-48c7-ad4e-dd107d21e234</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="uuid">ca2c5495-7eb1-48c7-ad4e-dd107d21e234</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/disk.config"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <alias name="ua-67b4244b-cfa3-4d57-bcae-1e03acad5e23"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-4"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <serial>67b4244b-cfa3-4d57-bcae-1e03acad5e23</serial>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:b7:a3:ed"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <target dev="tapf19351a2-6e"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/console.log" append="off"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:00:01.311786 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Preparing to wait for external event network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T02:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-image-snapshot-server-1004091999',id=77,image_ref='14434e37-b0e6-4b6e-b174-1f847430ddd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY7FLe7+zqiVra5Wx1T6VS2fCCZLGZIE2hv+5PC/+wnicDr5/+wAucHtE94AZ+Gxh016m1CdBzgcfXFNCv05LdUgLn7uG05nyiMq47RYe+PcIO+XiSZjRv5wMHYmIjj4w==',key_name='tempest-keypair-485424707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-1m07i0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1425057934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T02:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=ca2c5495-7eb1-48c7-ad4e-dd107d21e234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:00:01.316531 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.317148 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:01.317203 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:00:01.318576 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.318795 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88993280-4725-5586-b23e-95626197a741', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:01.322122 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.322709 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:01.326978 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.327371 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf19351a2-6e, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:01.328377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf19351a2-6e, col_values=(('qos', UUID('8b4e14bb-b8c9-4d47-b238-313a98d89f4c')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:01.328377 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf19351a2-6e, col_values=(('external_ids', {'iface-id': 'f19351a2-6e70-4c77-9b6c-f925cb370471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:a3:ed', 'vm-uuid': 'ca2c5495-7eb1-48c7-ad4e-dd107d21e234'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:01.333472 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.335238 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:01.340844 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:01.342198 np0000003683 nova-compute[98991]: INFO os_vif [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e')
Jun 26 03:00:02.001920 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 5f20da65-2d84-4541-9190-ea4e4da46e0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:00:02.002515 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 775de962-784d-4dfd-8d16-f80f6f622705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:00:02.002515 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance ca2c5495-7eb1-48c7-ad4e-dd107d21e234 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:00:02.002515 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 3 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:00:02.002681 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=1088MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:00:00 up 46 min,  2 users,  load average: 2.66, 4.42, 4.58\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '2', 'io_workload': '1', 'num_proj_dc75731d341143958b1030ac806f2343': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:00:02.211681 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:00:02.211863 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:00:02.476887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:02.714613 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:00:02.867642 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:00:02.867811 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:00:02.867917 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:b7:a3:ed, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:00:02.868446 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Using config drive
Jun 26 03:00:03.222061 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:00:03.222682 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.294s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:03.222682 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:03.376359 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:03.520107 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Creating config drive at /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/disk.config
Jun 26 03:00:03.524170 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp84_d9pjf {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:00:03.587454 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp84_d9pjf" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:00:04.048745 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.075326 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.078492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.180086 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.235000 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.236283 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:04.289990 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e269768-f5fe-4ba8-9f92-4595383b32ad req-f2cd34fc-c96e-47e9-bc32-7e0c11cc0eaa service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:04.290314 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e269768-f5fe-4ba8-9f92-4595383b32ad req-f2cd34fc-c96e-47e9-bc32-7e0c11cc0eaa service nova] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:04.290589 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e269768-f5fe-4ba8-9f92-4595383b32ad req-f2cd34fc-c96e-47e9-bc32-7e0c11cc0eaa service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:04.290803 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7e269768-f5fe-4ba8-9f92-4595383b32ad req-f2cd34fc-c96e-47e9-bc32-7e0c11cc0eaa service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:04.291014 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7e269768-f5fe-4ba8-9f92-4595383b32ad req-f2cd34fc-c96e-47e9-bc32-7e0c11cc0eaa service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Processing event network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:00:04.918504 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442804.9180357, ca2c5495-7eb1-48c7-ad4e-dd107d21e234 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:04.918693 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] VM Started (Lifecycle Event)
Jun 26 03:00:04.920647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:00:04.923580 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:00:04.926251 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance spawned successfully.
Jun 26 03:00:04.926559 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:00:04.929494 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:04.929856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:05.223301 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:05.223718 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:05.224114 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:05.224543 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:05.390006 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:05.390652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:05.422228 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:05.424462 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:00:05.437850 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Took 8.20 seconds to spawn the instance on the hypervisor.
Jun 26 03:00:05.438273 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:05.894335 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 03:00:05.927341 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:00:05.927778 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442805.927511, ca2c5495-7eb1-48c7-ad4e-dd107d21e234 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:05.927979 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] VM Paused (Lifecycle Event)
Jun 26 03:00:05.955778 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Took 18.30 seconds to build instance.
Jun 26 03:00:06.332801 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:06.344660 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:06.345221 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:06.356435 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:06.357334 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:06.357539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:06.357703 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:06.357888 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] No waiting events found dispatching network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:06.358098 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-7609fcf4-c8ae-4eb0-b8f6-54449b4b06b3 req-cc676eb2-aff8-4874-bbd0-6da684f52a1f service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received unexpected event network-vif-plugged-f19351a2-6e70-4c77-9b6c-f925cb370471 for instance with vm_state active and task_state None.
Jun 26 03:00:06.431298 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:06.435201 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442806.4347785, ca2c5495-7eb1-48c7-ad4e-dd107d21e234 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:06.435379 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] VM Resumed (Lifecycle Event)
Jun 26 03:00:06.450104 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:06.451631 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:06.456773 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 03:00:06.457069 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Claim successful on node np0000003683
Jun 26 03:00:06.461102 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.815s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:06.938046 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:06.943866 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:00:07.343942 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:07.344263 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:07.479523 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:07.744655 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:07.796043 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:00:07.796281 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:00:07.813788 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-changed-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:07.815193 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Refreshing instance network info cache due to event network-changed-f19351a2-6e70-4c77-9b6c-f925cb370471. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:07.815193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] Acquiring lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:07.815193 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] Acquired lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:07.815193 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Refreshing network info cache for port f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:08.299028 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:00:08.322552 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:08.685134 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:08.807166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:08.807565 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 03:00:08.826620 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updated VIF entry in instance network info cache for port f19351a2-6e70-4c77-9b6c-f925cb370471. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:00:08.826620 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updating instance_info_cache with network_info: [{"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:09.313562 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 03:00:09.313787 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 03:00:09.314104 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:09.314343 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:09.330904 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-0151efdb-20a0-4029-9f9a-56526db208f7 req-010faf9f-6921-4b59-a971-179aae851d7c service nova] Releasing lock "refresh_cache-ca2c5495-7eb1-48c7-ad4e-dd107d21e234" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:09.405781 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d7f036feb0484290b0c45ee5d80bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083fd09bdb84fab848b17e71e63b280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 03:00:09.816954 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 03:00:09.917192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Successfully created port: aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 03:00:10.322347 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 03:00:10.340542 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:10.340944 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:10.539328 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Successfully updated port: aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 03:00:10.598245 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:10.598462 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing instance network info cache due to event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:10.598855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:10.598855 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:10.599049 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:10.829573 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Booting with volume 58e936c2-c1d0-4577-8d30-118325bc60f6 at /dev/vda
Jun 26 03:00:10.870616 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:10.886115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 03:00:10.910597 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:00:10.964576 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 03:00:10.964883 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 03:00:10.975260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 03:00:10.976626 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fee4:7a6b', 'fe80::d4b5:11ff:fee7:5f60', 'fe80::fc16:3eff:fe57:d993', 'fe80::a87e:a5ff:fe85:a081', 'fe80::fc16:3eff:feb7:a3ed'] 
Jun 26 03:00:10.976818 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 03:00:10.977405 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 03:00:10.977835 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:10.978048 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating existing volume attachment record: f29eeabc-9deb-40a8-bd82-bda189943763 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 03:00:11.043162 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:11.103324 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:11.170087 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:00:11.335834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:11.338820 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:11.841422 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9d0f36ae-f151-4111-acb6-b66cc4fb0d64 req-d9033c4f-3b41-4f78-b691-cb4c5f06429b service nova] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:11.842613 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:11.842777 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 03:00:12.426386 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:00:12.480445 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:12.594501 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:12.753305 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:13.092731 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 03:00:13.094131 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 03:00:13.094804 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Creating image(s)
Jun 26 03:00:13.095216 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 03:00:13.095408 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Ensure instance console log exists: /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 03:00:13.095942 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:13.096207 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:13.096408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:13.256818 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:13.256818 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance network_info: |[{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 03:00:13.257547 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Start _get_guest_xml network_info=[{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f29eeabc-9deb-40a8-bd82-bda189943763', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7c98d354-dc9d-4db2-bb27-b7cd1c55b30e', 'attached_at': '', 'detached_at': '', 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'serial': '58e936c2-c1d0-4577-8d30-118325bc60f6'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 03:00:13.264409 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:00:13.266077 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-641468957', uuid='7c98d354-dc9d-4db2-bb27-b7cd1c55b30e'), owner=OwnerMeta(userid='53d7f036feb0484290b0c45ee5d80bfd', username='tempest-TestVolumeBackupRestore-507346053-project-member', projectid='a083fd09bdb84fab848b17e71e63b280', projectname='tempest-TestVolumeBackupRestore-507346053'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442813.265534) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 03:00:13.268026 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 03:00:13.268441 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 03:00:13.269950 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 03:00:13.270188 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 03:00:13.272420 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 03:00:13.272420 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 03:00:13.272750 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 03:00:13.272750 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 03:00:13.272859 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 03:00:13.272996 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 03:00:13.273091 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 03:00:13.273823 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 03:00:13.273991 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 03:00:13.274088 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 03:00:13.274212 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 03:00:13.274382 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 03:00:13.287869 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 03:00:13.288405 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:13.288619 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:13.289221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:13.289736 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 03:00:13.304439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:13.305192 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:13.305770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:13.306066 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:00:13.306503 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:13.306781 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:00:13.319977 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:00:13.319977 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:13.327318 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:00:13.327318 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6] added
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:00:13.335331 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:13.335638 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:00:13.336000 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:00:13.336204 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6] added
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:00:13.341840 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:13.342108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:00:13.342172 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:00:13.342287 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:00:14.336741 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:00:14.342849 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:00:14.356765 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:00:14.365496 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.376457 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.383808 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.394796 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.395154 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.400911 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.401234 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:14.431125 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260]
Jun 26 03:00:14.431125 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] successful.
Jun 26 03:00:14.431125 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.439848 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.50.100,3260]
Jun 26 03:00:14.439848 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.50.100,3260] successful.
Jun 26 03:00:14.439848 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.444408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.451501 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.459796 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.460226 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:14.460491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:14.460491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:00:14.461656 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] HCTL ('11', '-', '-', 0) found on session 221 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:00:14.461794 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.469195 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:14.469552 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:14.469798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:14.469798 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:00:14.470842 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] HCTL ('14', '-', '-', 0) found on session 222 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:00:14.471037 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:00:14.479014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Searching for a device in session 221 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:00:14.479224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:00:14.489647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Searching for a device in session 222 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:00:14.489647 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:00:15.306821 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 03:00:16.324041 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Found WWN 330000000c1e0882c for multipath device dm-8 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:00:16.324564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:16.324564 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000c1e0882c', 'path': '/dev/dm-8', 'multipath_id': '330000000c1e0882c'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:16.324658 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c1e0882c', 'path': '/dev/dm-8', 'multipath_id': '330000000c1e0882c'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:00:16.338943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:16.831828 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-641468957',display_name='tempest-TestVolumeBackupRestore-server-641468957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebackuprestore-server-641468957',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYFeZRuo+Of1FHbn0zrzG2ykbaacxp0ZvxPS3is4Dz6tZnp+yba7uzbx2rla9IXk94b2tOVmKpFqm8lKQ0JxSqsuclO/2BYdyXVtHcPmwt/ap+1U+vG+iM0P8YY+/vGBA==',key_name='tempest-TestVolumeBackupRestore-105019709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a083fd09bdb84fab848b17e71e63b280',ramdisk_id='',reservation_id='r-0uvnowfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-507346053',owner_user_name='tempest-TestVolumeBackupRestore-507346053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:00:10Z,user_data=None,user_id='53d7f036feb0484290b0c45ee5d80bfd',uuid=7c98d354-dc9d-4db2-bb27-b7cd1c55b30e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:00:16.832224 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converting VIF {"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:16.833073 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:16.833944 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <uuid>7c98d354-dc9d-4db2-bb27-b7cd1c55b30e</uuid>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <name>instance-0000004e</name>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBackupRestore-server-641468957</nova:name>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 03:00:13</nova:creationTime>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:user uuid="53d7f036feb0484290b0c45ee5d80bfd">tempest-TestVolumeBackupRestore-507346053-project-member</nova:user>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:project uuid="a083fd09bdb84fab848b17e71e63b280">tempest-TestVolumeBackupRestore-507346053</nova:project>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         <nova:port uuid="aaae948e-a90f-4275-9503-abd7579d38a6">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="serial">7c98d354-dc9d-4db2-bb27-b7cd1c55b30e</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="uuid">7c98d354-dc9d-4db2-bb27-b7cd1c55b30e</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/disk.config"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <alias name="ua-58e936c2-c1d0-4577-8d30-118325bc60f6"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-8"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <serial>58e936c2-c1d0-4577-8d30-118325bc60f6</serial>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:6d:73:17"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <target dev="tapaaae948e-a9"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/console.log" append="off"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:00:17.337807 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Preparing to wait for external event network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-641468957',display_name='tempest-TestVolumeBackupRestore-server-641468957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebackuprestore-server-641468957',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYFeZRuo+Of1FHbn0zrzG2ykbaacxp0ZvxPS3is4Dz6tZnp+yba7uzbx2rla9IXk94b2tOVmKpFqm8lKQ0JxSqsuclO/2BYdyXVtHcPmwt/ap+1U+vG+iM0P8YY+/vGBA==',key_name='tempest-TestVolumeBackupRestore-105019709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a083fd09bdb84fab848b17e71e63b280',ramdisk_id='',reservation_id='r-0uvnowfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-507346053',owner_user_name='tempest-TestVolumeBackupRestore-507346053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:00:10Z,user_data=None,user_id='53d7f036feb0484290b0c45ee5d80bfd',uuid=7c98d354-dc9d-4db2-bb27-b7cd1c55b30e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converting VIF {"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.341842 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '487e350c-396a-5568-8547-7cbae5e39d4b', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:17.342572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.343236 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:17.344895 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.347111 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.347239 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaae948e-a9, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:17.347521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaae948e-a9, col_values=(('qos', UUID('b4698380-45ea-4cc2-8d47-125195fa6d75')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:17.347674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaae948e-a9, col_values=(('external_ids', {'iface-id': 'aaae948e-a90f-4275-9503-abd7579d38a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:73:17', 'vm-uuid': '7c98d354-dc9d-4db2-bb27-b7cd1c55b30e'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:17.348406 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.352124 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:17.358692 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:17.359565 np0000003683 nova-compute[98991]: INFO os_vif [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9')
Jun 26 03:00:17.481207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:18.876350 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:00:18.876829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:00:18.876829 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] No VIF found with MAC fa:16:3e:6d:73:17, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:00:18.877003 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Using config drive
Jun 26 03:00:19.382063 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:19.548774 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Creating config drive at /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/disk.config
Jun 26 03:00:19.551735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjlsxrx7 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:00:19.625309 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjlsxrx7" returned: 0 in 0.073s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:00:20.077188 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.110181 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.194195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.284191 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b85caf2e-f778-4f0a-9f40-8af2f84e8d60 req-2e4e14e0-73c0-4178-817b-cdeca48d5d5c service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:20.284191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b85caf2e-f778-4f0a-9f40-8af2f84e8d60 req-2e4e14e0-73c0-4178-817b-cdeca48d5d5c service nova] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:20.284191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b85caf2e-f778-4f0a-9f40-8af2f84e8d60 req-2e4e14e0-73c0-4178-817b-cdeca48d5d5c service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:20.284191 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b85caf2e-f778-4f0a-9f40-8af2f84e8d60 req-2e4e14e0-73c0-4178-817b-cdeca48d5d5c service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:20.284381 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b85caf2e-f778-4f0a-9f40-8af2f84e8d60 req-2e4e14e0-73c0-4178-817b-cdeca48d5d5c service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Processing event network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:00:20.424453 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.428383 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.451843 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:20.875373 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442820.8747861, 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:20.875572 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] VM Started (Lifecycle Event)
Jun 26 03:00:20.877264 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:00:20.881148 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:00:20.883639 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance spawned successfully.
Jun 26 03:00:20.885796 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:00:21.379078 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:21.382838 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.394510 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:00:21.886870 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:00:21.887090 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442821.8868656, 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:21.887260 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] VM Paused (Lifecycle Event)
Jun 26 03:00:21.899332 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Took 8.81 seconds to spawn the instance on the hypervisor.
Jun 26 03:00:21.900651 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:22.349165 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:22.361346 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:22.361562 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:22.361744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:22.362147 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:22.362147 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] No waiting events found dispatching network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:22.362319 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-28ee4fad-ed3e-4083-acc0-745adedde058 req-58c0dbe2-e5c9-4a13-b9aa-057c3907b523 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received unexpected event network-vif-plugged-aaae948e-a90f-4275-9503-abd7579d38a6 for instance with vm_state active and task_state None.
Jun 26 03:00:22.389797 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:22.392241 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442822.3919683, 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:22.392411 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] VM Resumed (Lifecycle Event)
Jun 26 03:00:22.410314 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Took 16.01 seconds to build instance.
Jun 26 03:00:22.482810 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:22.895259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:22.897762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:00:22.911543 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.521s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:24.521257 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:24.521836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing instance network info cache due to event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:24.522159 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:24.522281 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:24.522512 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:25.025040 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:25.235022 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:25.235169 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing instance network info cache due to event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:25.235370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:25.359257 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:25.562209 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updated VIF entry in instance network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:00:25.562599 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:26.064844 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-9476f7af-caa3-4416-a92e-1958e92cc5f6 req-8a1f08ef-ffd0-4c02-b5ba-86d2f5996ef2 service nova] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:26.065283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:26.065493 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:26.568071 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:26.906858 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:27.058182 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updated VIF entry in instance network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:00:27.059070 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:27.294135 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:27.294220 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing instance network info cache due to event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:27.294438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:27.350811 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:27.484096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:27.560678 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-569ca024-a32a-4ebd-ae9b-3f0ad45313ae req-2b9f9475-3363-4a0d-91bb-5ca79a2623d0 service nova] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:27.561152 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:27.561293 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:28.063685 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:28.391683 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:28.565164 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updated VIF entry in instance network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:00:28.565560 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:29.068347 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-41dbcd37-dfa8-4485-9a03-90e5253529d6 req-12f17ec9-d4f1-492b-996c-46ad1a38a0fa service nova] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:32.352168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:32.485808 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:33.919823 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:33.920524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:33.920524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:33.920524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:33.920524 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:33.922681 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Terminating instance
Jun 26 03:00:34.425932 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:00:34.448092 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.455375 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.473380 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.475783 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.496134 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.638109 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:34.638585 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:34.638777 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:34.638940 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:34.639212 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] No waiting events found dispatching network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:34.639289 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c97ef407-8e07-49df-8b22-91aeeca8536c req-a6d0e11b-39fd-4cae-8387-64adcd5ac949 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:34.738634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.746883 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:34.771129 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99963963900018 future=<Future at 0x72e27c2f0410 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:34.772243 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.99845012500009 future=<Future at 0x72e27c2f0410 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:34.772397 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.998288995000166 future=<Future at 0x72e27c2f0410 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:34.774919 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Instance destroyed successfully.
Jun 26 03:00:34.775451 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'resources' on Instance uuid 775de962-784d-4dfd-8d16-f80f6f622705 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:35.278227 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-29639793',display_name='tempest-TestEncryptedCinderVolumes-server-29639793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-29639793',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:59:54Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-wckxa42c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:59:54Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=775de962-784d-4dfd-8d16-f80f6f622705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:00:35.278772 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "5e9af8a0-f084-401e-af3c-549f6dd52757", "address": "fa:16:3e:57:d9:93", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e9af8a0-f0", "ovs_interfaceid": "5e9af8a0-f084-401e-af3c-549f6dd52757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:35.278984 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:35.279235 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:00:35.280561 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.280834 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e9af8a0-f0, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:35.281840 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.282749 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:35.283454 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.284287 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.284563 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3e53d4c-11b7-47aa-bb09-5fdee185a1b4) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:35.285154 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.285622 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:35.286516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:35.288334 np0000003683 nova-compute[98991]: INFO os_vif [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d9:93,bridge_name='br-int',has_traffic_filtering=True,id=5e9af8a0-f084-401e-af3c-549f6dd52757,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e9af8a0-f0')
Jun 26 03:00:35.291533 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:00:35.291894 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:35.292094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:35.292511 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:35.292870 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3763222-4f1e-4d3a-93b7-33dc24c162f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:00:35.293072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:35.326733 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:35.327152 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '222')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:00:35.327379 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '217')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:35.328272 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '216')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:35.329038 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e27c579d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:00:35.329229 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:00:35.329437 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flush multipath device 330000000862ea2f8 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:00:35.357102 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:35.408319 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:35.458248 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:00:35.458509 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:00:35.459853 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:00:35.473636 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:00:35.473929 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:00:35.490043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.526784 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.40.100,3260]
Jun 26 03:00:35.526784 np0000003683 nova-compute[98991]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.40.100,3260] successful.
Jun 26 03:00:35.526784 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.544371 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.559470 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.590855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.50.100,3260]
Jun 26 03:00:35.590855 np0000003683 nova-compute[98991]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9, portal: 192.168.50.100,3260] successful.
Jun 26 03:00:35.590855 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.607368 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:35.608732 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:35.608887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== disconnect_volume: return (317ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:35.609078 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:00:35.609385 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Deleting instance files /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705_del
Jun 26 03:00:35.609932 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Deletion of /opt/stack/data/nova/instances/775de962-784d-4dfd-8d16-f80f6f622705_del complete
Jun 26 03:00:36.117411 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Took 1.69 seconds to destroy the instance on the hypervisor.
Jun 26 03:00:36.118310 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:00:36.118696 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:00:36.118802 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:00:36.119089 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:36.184015 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:36.720661 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:36.721171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] Acquiring lock "775de962-784d-4dfd-8d16-f80f6f622705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:36.721171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:36.721350 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] Lock "775de962-784d-4dfd-8d16-f80f6f622705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:36.721551 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] No waiting events found dispatching network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:36.722103 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-185103b0-d0b1-4232-a77b-21a6a8b34131 req-ebe74ca5-eeea-4dc4-bb44-23de1c8b9690 service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-unplugged-5e9af8a0-f084-401e-af3c-549f6dd52757 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:37.169460 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:37.488628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:37.671778 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Took 1.55 seconds to deallocate network for instance.
Jun 26 03:00:38.241132 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Took 0.57 seconds to detach 1 volumes for instance.
Jun 26 03:00:38.751603 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:38.751837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:38.795677 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-25b5863e-d2ff-43dd-821a-02ea32cc78ab req-87cdcd71-a0f5-4f1d-bf12-0af83c8a3f3d service nova] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Received event network-vif-deleted-5e9af8a0-f084-401e-af3c-549f6dd52757 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:39.017129 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:00:39.017369 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:00:39.520312 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:00:40.027295 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.275s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:40.099691 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deleted allocations for instance 775de962-784d-4dfd-8d16-f80f6f622705
Jun 26 03:00:40.286866 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:41.109231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-23950d5e-8f90-4cb7-8147-5c0e0347db9e tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "775de962-784d-4dfd-8d16-f80f6f622705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.189s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:42.491177 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:44.870247 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:44.870766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:44.870766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:44.870766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:44.870766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:44.872634 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Terminating instance
Jun 26 03:00:45.288212 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.376249 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:00:45.397742 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.405581 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.417256 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.564674 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.571725 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] No waiting events found dispatching network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:45.603202 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-adfcad0d-7281-4724-b6c3-0514c4a534f2 req-771cc546-5325-48f9-baf4-a66122abe024 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:45.723614 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999691837000228 future=<Future at 0x72e29c25a750 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:45.726524 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Instance destroyed successfully.
Jun 26 03:00:45.727040 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid ca2c5495-7eb1-48c7-ad4e-dd107d21e234 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:46.229503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1004091999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-image-snapshot-server-1004091999',id=77,image_ref='14434e37-b0e6-4b6e-b174-1f847430ddd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY7FLe7+zqiVra5Wx1T6VS2fCCZLGZIE2hv+5PC/+wnicDr5/+wAucHtE94AZ+Gxh016m1CdBzgcfXFNCv05LdUgLn7uG05nyiMq47RYe+PcIO+XiSZjRv5wMHYmIjj4w==',key_name='tempest-keypair-485424707',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:00:05Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-1m07i0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1425057934',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=ca2c5495-7eb1-48c7-ad4e-dd107d21e234,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:00:46.230173 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "f19351a2-6e70-4c77-9b6c-f925cb370471", "address": "fa:16:3e:b7:a3:ed", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19351a2-6e", "ovs_interfaceid": "f19351a2-6e70-4c77-9b6c-f925cb370471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:46.230173 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:46.230348 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:00:46.231490 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:46.231796 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf19351a2-6e, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:46.232978 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:46.235203 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:46.235949 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:46.236160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b4e14bb-b8c9-4d47-b238-313a98d89f4c) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:46.236971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:46.237672 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:46.238398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:46.240662 np0000003683 nova-compute[98991]: INFO os_vif [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f19351a2-6e70-4c77-9b6c-f925cb370471,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19351a2-6e')
Jun 26 03:00:46.242724 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:00:46.243062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:46.243212 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:46.243658 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:46.244075 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67b4244b-cfa3-4d57-bcae-1e03acad5e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:00:46.244255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:46.279704 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '222'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '224')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:00:46.280099 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '220')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:46.281221 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '219')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:46.282207 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3c23e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'): ({'sdg'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:00:46.282413 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdh, sdg {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:00:46.282666 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000ae7175ba {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:00:46.344174 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:46.399412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:46.450563 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:00:46.450737 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:00:46.452345 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:00:46.466450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:00:46.466675 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:00:46.479887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.521845 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.40.100,3260]
Jun 26 03:00:46.521845 np0000003683 nova-compute[98991]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.40.100,3260] successful.
Jun 26 03:00:46.521845 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.542091 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.555692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.589774 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.50.100,3260]
Jun 26 03:00:46.589774 np0000003683 nova-compute[98991]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23, portal: 192.168.50.100,3260] successful.
Jun 26 03:00:46.589774 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.607093 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:46.607390 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:46.607582 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (363ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:46.607751 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:00:46.608088 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Deleting instance files /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234_del
Jun 26 03:00:46.608711 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Deletion of /opt/stack/data/nova/instances/ca2c5495-7eb1-48c7-ad4e-dd107d21e234_del complete
Jun 26 03:00:47.115767 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Took 1.74 seconds to destroy the instance on the hypervisor.
Jun 26 03:00:47.116471 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:00:47.116798 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:00:47.116889 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:00:47.117188 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:47.199546 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:47.493022 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] Acquiring lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] No waiting events found dispatching network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-unplugged-f19351a2-6e70-4c77-9b6c-f925cb370471 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Received event network-vif-deleted-f19351a2-6e70-4c77-9b6c-f925cb370471 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:47.671762 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Neutron deleted interface f19351a2-6e70-4c77-9b6c-f925cb370471; detaching it from the instance and deleting it from the info cache
Jun 26 03:00:47.673255 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-36b99f51-19c5-4d02-8e4e-7605c348c5fe req-bac0d825-065b-4e8a-8752-a7394e3b8419 service nova] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Detach interface failed, port_id=f19351a2-6e70-4c77-9b6c-f925cb370471, reason: Instance ca2c5495-7eb1-48c7-ad4e-dd107d21e234 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:00:48.119580 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:48.622043 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Took 1.50 seconds to deallocate network for instance.
Jun 26 03:00:49.188785 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Took 0.57 seconds to detach 1 volumes for instance.
Jun 26 03:00:49.190684 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Deleting volume: 67b4244b-cfa3-4d57-bcae-1e03acad5e23 {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 03:00:49.746555 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:49.747106 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:49.771221 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00040246599974125274 future=<Future at 0x72e27c2f0410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:49.771376 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:49.771516 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.95167420200005 future=<Future at 0x72e29c25a750 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:49.771659 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=10.951533029000075 future=<Future at 0x72e29c25a750 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:49.773039 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Emitting event <LifecycleEvent: 1782442834.7705872, 775de962-784d-4dfd-8d16-f80f6f622705 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:00:49.773039 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] VM Stopped (Lifecycle Event)
Jun 26 03:00:49.986763 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:00:49.986986 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:00:50.275558 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 775de962-784d-4dfd-8d16-f80f6f622705] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:00:50.489609 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:00:50.996688 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.250s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:51.046161 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance ca2c5495-7eb1-48c7-ad4e-dd107d21e234
Jun 26 03:00:51.238205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:52.054151 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-04f027fd-2f2e-4035-b553-88d60b011377 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "ca2c5495-7eb1-48c7-ad4e-dd107d21e234" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.184s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:52.339634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:52.495820 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:52.526502 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:52.526723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing instance network info cache due to event network-changed-aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:00:52.527058 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] Acquiring lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:00:52.527539 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] Acquired lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:00:52.527677 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Refreshing network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:00:53.032581 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:53.058171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:53.058737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:53.058737 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:53.058869 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:53.059030 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:53.061278 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Terminating instance
Jun 26 03:00:53.376673 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:53.517419 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updated VIF entry in instance network info cache for port aaae948e-a90f-4275-9503-abd7579d38a6. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:00:53.517654 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [{"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:53.564827 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:00:53.584565 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:53.586584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:53.608082 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:53.612940 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:53.648645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:53.791155 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:53.791400 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:53.792016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:53.792016 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:53.792016 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] No waiting events found dispatching network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:53.792556 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1ed491fe-e75d-4e55-aabe-6df88bedf138 req-0dca0e69-543a-4e47-a03f-95c9666a29c8 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:53.919755 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999617447999753 future=<Future at 0x72e29c339f70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:53.923321 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Instance destroyed successfully.
Jun 26 03:00:53.924845 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lazy-loading 'resources' on Instance uuid 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:54.019632 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cd237eb7-f8bc-4414-975f-affc5e5632c9 req-1ab54773-4822-4801-9446-bb39c72db200 service nova] Releasing lock "refresh_cache-7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:00:54.241843 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:54.242384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:54.242384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:54.242384 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:54.242504 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:54.244309 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Terminating instance
Jun 26 03:00:54.427349 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-641468957',display_name='tempest-TestVolumeBackupRestore-server-641468957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebackuprestore-server-641468957',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYFeZRuo+Of1FHbn0zrzG2ykbaacxp0ZvxPS3is4Dz6tZnp+yba7uzbx2rla9IXk94b2tOVmKpFqm8lKQ0JxSqsuclO/2BYdyXVtHcPmwt/ap+1U+vG+iM0P8YY+/vGBA==',key_name='tempest-TestVolumeBackupRestore-105019709',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:00:21Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a083fd09bdb84fab848b17e71e63b280',ramdisk_id='',reservation_id='r-0uvnowfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-507346053',owner_user_name='tempest-TestVolumeBackupRestore-507346053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:00:22Z,user_data=None,user_id='53d7f036feb0484290b0c45ee5d80bfd',uuid=7c98d354-dc9d-4db2-bb27-b7cd1c55b30e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:00:54.427705 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converting VIF {"id": "aaae948e-a90f-4275-9503-abd7579d38a6", "address": "fa:16:3e:6d:73:17", "network": {"id": "2bfe27b7-4865-48b0-8d13-301b79534700", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-166637381-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a083fd09bdb84fab848b17e71e63b280", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaae948e-a9", "ovs_interfaceid": "aaae948e-a90f-4275-9503-abd7579d38a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:54.428233 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:54.428807 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:00:54.429381 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.429572 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaae948e-a9, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:54.439633 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.440524 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:54.441215 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.441351 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4698380-45ea-4cc2-8d47-125195fa6d75) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:54.441754 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.442196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:54.442727 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.445108 np0000003683 nova-compute[98991]: INFO os_vif [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:73:17,bridge_name='br-int',has_traffic_filtering=True,id=aaae948e-a90f-4275-9503-abd7579d38a6,network=Network(2bfe27b7-4865-48b0-8d13-301b79534700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaae948e-a9')
Jun 26 03:00:54.447024 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:00:54.447354 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:54.447532 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:54.447891 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:54.448282 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:00:54.448435 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:54.474644 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:54.474880 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '222'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '224')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:00:54.475100 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '221')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:54.475851 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '222')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:54.476579 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29e7b7240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'): ({'sdi'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:00:54.476887 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Removing multipathed devices sdi, sdf {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:00:54.477122 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Flush multipath device 330000000c1e0882c {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:00:54.535821 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:54.592023 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:54.624760 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Checking to see if SCSI volumes sdi, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:00:54.624940 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] SCSI volumes sdi, sdf have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:00:54.625964 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Checking to see if device paths {'sdi', 'sdf'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:00:54.637780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Device paths {'sdi', 'sdf'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:00:54.638138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:00:54.649499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.677463 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260]
Jun 26 03:00:54.677463 np0000003683 nova-compute[98991]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] successful.
Jun 26 03:00:54.677463 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.692054 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.704665 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.738676 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.50.100,3260]
Jun 26 03:00:54.738676 np0000003683 nova-compute[98991]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.50.100,3260] successful.
Jun 26 03:00:54.738676 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.747301 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:00:54.753624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:54.753925 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:54.754055 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] <== disconnect_volume: return (306ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:54.754173 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:00:54.754395 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Deleting instance files /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e_del
Jun 26 03:00:54.754974 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Deletion of /opt/stack/data/nova/instances/7c98d354-dc9d-4db2-bb27-b7cd1c55b30e_del complete
Jun 26 03:00:54.765195 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.771266 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.780829 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.784757 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:54.804651 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.074865 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999747979999938 future=<Future at 0x72e29c2b81a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:00:55.077550 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Instance destroyed successfully.
Jun 26 03:00:55.077894 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 5f20da65-2d84-4541-9190-ea4e4da46e0b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:00:55.261427 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Took 1.70 seconds to destroy the instance on the hypervisor.
Jun 26 03:00:55.262238 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:00:55.262416 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:00:55.262560 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:00:55.263289 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:55.371373 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:55.580679 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T02:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838288422',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838288422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-volume-backed-server-838288422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMdreGe7raEJxhXV2aosTwZCvTUVTnfbNklxU4eKBx4C7OtXqZoeFM7gEgmzht+nYShKaRoVI8267zysRujsv19ybzI3drTp9uKSqvvY8sLYMh322F5Fb7uL7cWOZXttA==',key_name='tempest-keypair-1282475371',keypairs=<?>,launch_index=0,launched_at=2026-06-26T02:59:04Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-uxi41twm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T02:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='199454a2a0fb47729d1397c88a5735d4',uuid=5f20da65-2d84-4541-9190-ea4e4da46e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:00:55.581593 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "address": "fa:16:3e:e4:7a:6b", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aece55f-3b", "ovs_interfaceid": "6aece55f-3b8d-4753-a7e7-0fb9cd5d3679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:00:55.581752 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:00:55.582117 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:00:55.583118 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.583344 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aece55f-3b, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:55.584313 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.585095 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:55.586010 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.586688 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.586854 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=681ab4e9-0f5e-47ee-b09b-96b55f585893) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:00:55.587570 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.588189 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:00:55.588683 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:00:55.592511 np0000003683 nova-compute[98991]: INFO os_vif [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aece55f-3b')
Jun 26 03:00:55.594593 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:00:55.594948 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:00:55.595094 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:00:55.595452 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:00:55.595820 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '658d91ad-0838-47a5-926c-5b8fdbdcf1db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:00:55.595965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:00:55.622224 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:55.622224 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:55.622224 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:00:55.622528 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:55.622528 np0000003683 nova-compute[98991]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash)
Jun 26 03:00:55.622528 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:00:55.622637 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:00:55.622877 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:55.623727 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:00:55.624448 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:00:55.624689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:00:55.624952 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000ad3ece3d {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:00:55.683187 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:55.731317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:00:55.783499 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:00:55.783704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:00:55.784335 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:00:55.797134 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:00:55.797294 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:00:55.810021 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.841115 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.40.100,3260]
Jun 26 03:00:55.841115 np0000003683 nova-compute[98991]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.40.100,3260] successful.
Jun 26 03:00:55.841115 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.856246 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.868704 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.875280 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:55.875862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Acquiring lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:55.875862 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:55.876036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:55.876163 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] No waiting events found dispatching network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:55.876829 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-unplugged-aaae948e-a90f-4275-9503-abd7579d38a6 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:55.876829 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:55.876829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:55.876829 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:55.877983 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:55.877983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] No waiting events found dispatching network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:55.877983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:55.877983 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:55.878117 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Acquiring lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:55.878236 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:55.878408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:55.878587 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] No waiting events found dispatching network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:00:55.878837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-unplugged-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:00:55.878884 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Received event network-vif-deleted-aaae948e-a90f-4275-9503-abd7579d38a6 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:55.879183 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Neutron deleted interface aaae948e-a90f-4275-9503-abd7579d38a6; detaching it from the instance and deleting it from the info cache
Jun 26 03:00:55.881210 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-a1f814a3-599e-4fe5-a12c-87940ee819d0 req-c2399254-c621-484c-870c-34d7ce534479 service nova] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Detach interface failed, port_id=aaae948e-a90f-4275-9503-abd7579d38a6, reason: Instance 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:00:55.908069 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.50.100,3260]
Jun 26 03:00:55.908069 np0000003683 nova-compute[98991]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db, portal: 192.168.50.100,3260] successful.
Jun 26 03:00:55.908069 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.922432 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:00:55.922739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:00:55.922936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (328ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:00:55.923120 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:00:55.923424 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Deleting instance files /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b_del
Jun 26 03:00:55.924114 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Deletion of /opt/stack/data/nova/instances/5f20da65-2d84-4541-9190-ea4e4da46e0b_del complete
Jun 26 03:00:56.093577 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:56.432419 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Took 1.68 seconds to destroy the instance on the hypervisor.
Jun 26 03:00:56.433110 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:00:56.433329 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:00:56.433441 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:00:56.433719 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:56.568220 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:00:56.595675 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Took 1.33 seconds to deallocate network for instance.
Jun 26 03:00:56.951139 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:56.951726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:57.153014 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b133350-e0ad-48f4-8cce-3053088c27bc req-e4d72ec6-07c2-462a-8dce-59a26d572686 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Received event network-vif-deleted-6aece55f-3b8d-4753-a7e7-0fb9cd5d3679 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:00:57.154966 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 03:00:57.156793 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-3b133350-e0ad-48f4-8cce-3053088c27bc req-e4d72ec6-07c2-462a-8dce-59a26d572686 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Neutron deleted interface 6aece55f-3b8d-4753-a7e7-0fb9cd5d3679; detaching it from the instance and deleting it from the info cache
Jun 26 03:00:57.159166 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3b133350-e0ad-48f4-8cce-3053088c27bc req-e4d72ec6-07c2-462a-8dce-59a26d572686 service nova] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Detach interface failed, port_id=6aece55f-3b8d-4753-a7e7-0fb9cd5d3679, reason: Instance 5f20da65-2d84-4541-9190-ea4e4da46e0b could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:00:57.344110 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:00:57.344494 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:00:57.453903 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 03:00:57.604038 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:00:57.660821 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:57.661043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:57.858389 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:00:57.858552 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:00:58.005530 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:58.106499 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Took 1.67 seconds to deallocate network for instance.
Jun 26 03:00:58.361334 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:00:58.663364 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 03:00:58.666004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Deleting volume: 658d91ad-0838-47a5-926c-5b8fdbdcf1db {{(pid=98991) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 26 03:00:58.868406 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.207s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:00:58.870243 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.865s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:00:58.874078 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 03:00:58.874237 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Claim successful on node np0000003683
Jun 26 03:00:58.936529 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Deleted allocations for instance 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e
Jun 26 03:00:59.211534 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:00:59.948445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-6c5496f6-2c4b-43d1-8f6e-764a11256f10 tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Lock "7c98d354-dc9d-4db2-bb27-b7cd1c55b30e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.889s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:00.042398 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:01:00.042677 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:01:00.344176 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:00.344378 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:01:00.344552 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:00.545375 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:01:00.588611 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:00.723612 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0003770280000026105 future=<Future at 0x72e29c25a750 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:00.724239 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442845.7231085, ca2c5495-7eb1-48c7-ad4e-dd107d21e234 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:00.724461 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:00.724772 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] VM Stopped (Lifecycle Event)
Jun 26 03:01:00.726058 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.193285273000129 future=<Future at 0x72e29c339f70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:00.726218 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=8.193096851000064 future=<Future at 0x72e29c339f70 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:00.850136 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:01.053891 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.184s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:01.055273 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.843s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:01.056226 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 03:01:01.228318 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: ca2c5495-7eb1-48c7-ad4e-dd107d21e234] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:01.246313 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:01:01.246738 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:01:01.562195 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 03:01:01.562934 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 03:01:01.563259 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:01.563561 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:01.637977 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '209bf2f2739a4be69e4ecbddb9411821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc75731d341143958b1030ac806f2343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 03:01:01.750395 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:01:02.069785 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 03:01:02.259876 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.205s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:02.262000 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.410s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:02.262437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:02.262638 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:01:02.285226 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:01:02.286369 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:01:02.318504 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Successfully created port: 55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 03:01:02.349271 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.063s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:01:02.349693 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51940MB free_disk=71.6849136352539GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:01:02.349962 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:02.350130 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:02.368133 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 5f20da65-2d84-4541-9190-ea4e4da46e0b
Jun 26 03:01:02.576331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 03:01:02.857324 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Successfully updated port: 55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 03:01:02.908117 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-changed-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:02.908373 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Refreshing instance network info cache due to event network-changed-55245f97-2a1c-4c13-902c-dd12fbf92863. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:01:02.908603 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] Acquiring lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:02.908744 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] Acquired lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:02.908929 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Refreshing network info cache for port 55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:01:03.082981 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Booting with volume ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 at /dev/vda
Jun 26 03:01:03.141724 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:01:03.154981 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 03:01:03.178332 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:01:03.227145 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 03:01:03.227542 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 03:01:03.237060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 03:01:03.238033 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246'] 
Jun 26 03:01:03.238213 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 03:01:03.238373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 03:01:03.238699 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:01:03.239012 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updating existing volume attachment record: f59bb29e-d38c-4fc9-8945-eb20acedf0a1 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 03:01:03.365768 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:03.380135 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-597c75e4-2d33-462a-bf6b-274638c03ebd tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "5f20da65-2d84-4541-9190-ea4e4da46e0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.138s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:03.406321 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:03.411390 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:03.448213 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 80a5b00e-97c4-47da-b270-1b8a3bfb642b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:01:03.448493 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:01:03.448692 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:01:02 up 47 min,  2 users,  load average: 3.07, 4.18, 4.48\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_os_type_None': '1', 'num_proj_dc75731d341143958b1030ac806f2343': '1', 'io_workload': '1'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:01:03.523853 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:01:03.554176 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:01:03.554176 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:01:03.685956 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:04.056751 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:01:04.188068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3fdb292f-8dc2-4c70-8dcb-122b1ff93d69 req-0b6ab19d-8496-4712-9a7a-515ac4629bea service nova] Releasing lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:04.188612 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquired lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:04.188866 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 03:01:04.564945 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:01:04.565132 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.215s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:04.565554 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:01:04.780847 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:01:04.954074 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:05.304662 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updating instance_info_cache with network_info: [{"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:05.388718 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 03:01:05.389851 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 03:01:05.390128 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Creating image(s)
Jun 26 03:01:05.390452 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 03:01:05.390645 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Ensure instance console log exists: /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 03:01:05.390919 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:05.391095 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:05.391203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:05.565419 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:05.565657 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:05.565916 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:05.566195 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.78 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:01:05.599467 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:05.806863 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Releasing lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:05.807171 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance network_info: |[{"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 03:01:05.808031 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Start _get_guest_xml network_info=[{"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f59bb29e-d38c-4fc9-8945-eb20acedf0a1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '80a5b00e-97c4-47da-b270-1b8a3bfb642b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'serial': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 03:01:05.810633 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:01:05.811837 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1768750300', uuid='80a5b00e-97c4-47da-b270-1b8a3bfb642b'), owner=OwnerMeta(userid='209bf2f2739a4be69e4ecbddb9411821', username='tempest-TestEncryptedCinderVolumes-1323610914-project-member', projectid='dc75731d341143958b1030ac806f2343', projectname='tempest-TestEncryptedCinderVolumes-1323610914'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442865.8114314) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 03:01:05.812978 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 03:01:05.813332 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 03:01:05.814363 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 03:01:05.814573 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 03:01:05.815416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 03:01:05.815723 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 03:01:05.815847 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 03:01:05.815953 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 03:01:05.816064 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 03:01:05.816137 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 03:01:05.816233 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 03:01:05.816378 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 03:01:05.816464 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 03:01:05.816596 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 03:01:05.816686 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 03:01:05.816824 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:05.848266 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:01:05.859698 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:01:05.859698 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4] added
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:01:05.873770 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4] added
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:05.877514 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:05.877866 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:01:05.877919 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:01:05.878071 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:01:06.780108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:06.872355 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:01:06.878471 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:01:06.887385 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:01:06.895173 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:06.902453 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:06.909664 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:06.915906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:01:06.915906 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:06.915906 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:01:06.915906 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:06.916144 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 03:01:06.916144 np0000003683 nova-compute[98991]: 
Jun 26 03:01:06.924015 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:01:06.924015 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:06.924177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:01:06.924177 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:06.924326 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 03:01:06.924326 np0000003683 nova-compute[98991]: 
Jun 26 03:01:07.344107 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:07.344521 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:01:07.966996 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.50.100,3260]
Jun 26 03:01:07.966996 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.50.100,3260] successful.
Jun 26 03:01:07.966996 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:07.979446 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.40.100,3260]
Jun 26 03:01:07.979446 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.40.100,3260] successful.
Jun 26 03:01:07.979446 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:07.993062 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:08.003820 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.164s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:08.010679 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:01:08.012415 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:01:08.012571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:01:08.018632 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.018632 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.018632 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:08.018836 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.018836 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:08.018836 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:08.019438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.172s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:08.019438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:01:08.020358 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:01:08.020602 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:01:08.035063 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:01:08.052702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:01:08.052702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:01:08.344236 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:08.344719 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:01:08.920095 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0006930409999768017 future=<Future at 0x72e29c339f70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:08.920655 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442853.919254, 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:08.920813 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:08.921025 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] VM Stopped (Lifecycle Event)
Jun 26 03:01:08.921131 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.1534548320000795 future=<Future at 0x72e29c2b81a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:08.922206 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=1.1523894990000372 future=<Future at 0x72e29c2b81a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:09.035663 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:01:09.036116 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:01:09.423605 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-6fbb705e-4bef-41c4-bcc6-0823d7408333 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 7c98d354-dc9d-4db2-bb27-b7cd1c55b30e] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:09.867350 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Found WWN 330000000b815ccd6 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:01:09.867672 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:09.868819 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '330000000b815ccd6', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b815ccd6'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:01:09.869024 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b815ccd6', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b815ccd6'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:01:09.900612 np0000003683 nova-compute[98991]: DEBUG os_brick.encryptors [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '80a5b00e-97c4-47da-b270-1b8a3bfb642b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'serial': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'} {{(pid=98991) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 26 03:01:09.901235 np0000003683 nova-compute[98991]: WARNING stevedore.named [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 26 03:01:09.901497 np0000003683 nova-compute[98991]: WARNING castellan.key_manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 03:01:09.901690 np0000003683 nova-compute[98991]: WARNING nova.keymgr.conf_key_mgr [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]:   <usage type="volume">
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]:     <volume>ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4</volume>
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]:   </usage>
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]: </secret>
Jun 26 03:01:09.919602 np0000003683 nova-compute[98991]:  {{(pid=98991) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 26 03:01:10.075171 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005484049997903639 future=<Future at 0x72e29c2b81a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:10.075806 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:10.075883 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] Emitting event <LifecycleEvent: 1782442855.0745192, 5f20da65-2d84-4541-9190-ea4e4da46e0b => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:10.076173 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] VM Stopped (Lifecycle Event)
Jun 26 03:01:10.442348 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1768750300',display_name='tempest-TestEncryptedCinderVolumes-server-1768750300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1768750300',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-ahpxfxbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:01:03Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=80a5b00e-97c4-47da-b270-1b8a3bfb642b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:01:10.442652 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:01:10.443179 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:01:10.444100 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'pci_devices' on Instance uuid 80a5b00e-97c4-47da-b270-1b8a3bfb642b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:01:10.579041 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4e9d2673-51fb-4dc5-891e-44aed34d347d tempest-TestVolumeBackupRestore-507346053 tempest-TestVolumeBackupRestore-507346053-project-member] [instance: 5f20da65-2d84-4541-9190-ea4e4da46e0b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:10.601660 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.700445 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:10.700625 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <uuid>80a5b00e-97c4-47da-b270-1b8a3bfb642b</uuid>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <name>instance-0000004f</name>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1768750300</nova:name>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 03:01:05</nova:creationTime>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:user uuid="209bf2f2739a4be69e4ecbddb9411821">tempest-TestEncryptedCinderVolumes-1323610914-project-member</nova:user>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:project uuid="dc75731d341143958b1030ac806f2343">tempest-TestEncryptedCinderVolumes-1323610914</nova:project>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <nova:port uuid="55245f97-2a1c-4c13-902c-dd12fbf92863">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="serial">80a5b00e-97c4-47da-b270-1b8a3bfb642b</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="uuid">80a5b00e-97c4-47da-b270-1b8a3bfb642b</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/disk.config"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <alias name="ua-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <serial>ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4</serial>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <encryption format="luks">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:         <secret type="passphrase" uuid="0ca484ad-8a03-484b-8fe1-cc73c7c9dd62"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       </encryption>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:25:b7:f9"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <target dev="tap55245f97-2a"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/console.log" append="off"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:01:10.947166 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Preparing to wait for external event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1768750300',display_name='tempest-TestEncryptedCinderVolumes-server-1768750300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1768750300',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-ahpxfxbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:01:03Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=80a5b00e-97c4-47da-b270-1b8a3bfb642b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:10.950606 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:01:10.951254 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.951368 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bba380f4-6add-5327-9403-c4107851fa16', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:10.952214 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.953063 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:10.954919 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.955124 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55245f97-2a, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:10.955504 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55245f97-2a, col_values=(('qos', UUID('2f683b2b-73c9-4f81-9ca3-a4ce158e255f')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:10.955710 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55245f97-2a, col_values=(('external_ids', {'iface-id': '55245f97-2a1c-4c13-902c-dd12fbf92863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:b7:f9', 'vm-uuid': '80a5b00e-97c4-47da-b270-1b8a3bfb642b'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:10.956638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.958501 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:10.962359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:10.963378 np0000003683 nova-compute[98991]: INFO os_vif [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a')
Jun 26 03:01:11.202856 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 03:01:11.768095 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:11.768352 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:11.772399 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 03:01:11.772646 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Claim successful on node np0000003683
Jun 26 03:01:12.484730 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:01:12.485307 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:01:12.485307 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] No VIF found with MAC fa:16:3e:25:b7:f9, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:01:12.485424 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Using config drive
Jun 26 03:01:12.916061 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:01:12.916241 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:01:12.991939 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:13.131167 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Creating config drive at /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/disk.config
Jun 26 03:01:13.134186 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpar0b8958 {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:01:13.193514 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpar0b8958" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:01:13.419970 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:01:13.653830 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:13.676160 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:13.679419 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:13.784199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:13.791226 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:13.829241 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fcfd457-aea6-41f4-a10f-471f83008f2f req-3d88a713-f60c-468e-8fc5-a056cee789cf service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:13.829845 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fcfd457-aea6-41f4-a10f-471f83008f2f req-3d88a713-f60c-468e-8fc5-a056cee789cf service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:13.830085 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fcfd457-aea6-41f4-a10f-471f83008f2f req-3d88a713-f60c-468e-8fc5-a056cee789cf service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:13.830202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1fcfd457-aea6-41f4-a10f-471f83008f2f req-3d88a713-f60c-468e-8fc5-a056cee789cf service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:13.830329 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1fcfd457-aea6-41f4-a10f-471f83008f2f req-3d88a713-f60c-468e-8fc5-a056cee789cf service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Processing event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:01:13.932080 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.164s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:13.932597 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 03:01:14.004876 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:14.009589 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:14.028665 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:14.438966 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 03:01:14.439192 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 03:01:14.439626 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:14.439873 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:14.522865 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 03:01:14.943343 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 03:01:15.126386 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Successfully created port: 860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 03:01:15.367019 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442875.3665378, 80a5b00e-97c4-47da-b270-1b8a3bfb642b => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:15.367250 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] VM Started (Lifecycle Event)
Jun 26 03:01:15.368670 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:01:15.372080 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:01:15.374577 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance spawned successfully.
Jun 26 03:01:15.374888 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:01:15.447458 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 03:01:15.682572 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Successfully updated port: 860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 03:01:15.784181 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-changed-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:15.784461 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Refreshing instance network info cache due to event network-changed-860fcdbe-c30d-4dbe-a12b-e6642344bd1f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:01:15.784674 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] Acquiring lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:15.784851 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] Acquired lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:15.784966 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Refreshing network info cache for port 860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:01:15.870278 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:15.872693 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:01:15.882211 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.882371 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.882737 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.882956 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.883194 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.883777 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:15.916224 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:15.916438 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:15.916722 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:15.916866 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:15.917063 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:15.917305 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-ee549382-15c6-4e7c-aebe-9deceebe7d21 req-a49a45a4-30b0-43b0-ad7d-3b5cfc3ced00 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received unexpected event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with vm_state building and task_state spawning.
Jun 26 03:01:15.951961 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Booting with volume 10dc4c0c-5316-4070-8ee7-9096c25e30ea at /dev/vda
Jun 26 03:01:15.958179 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:16.003897 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:01:16.017142 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 03:01:16.041507 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:01:16.099023 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 03:01:16.099341 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 03:01:16.111872 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 03:01:16.113227 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe25:b7f9', 'fe80::a87e:a5ff:fe85:a081'] 
Jun 26 03:01:16.113533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 03:01:16.113615 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 03:01:16.114120 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:01:16.114650 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updating existing volume attachment record: 64b42e51-1b9c-473c-b7ae-390075d68e48 {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 03:01:16.185255 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:16.287381 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:16.366039 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:01:16.375110 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:01:16.375690 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442876.3754072, 80a5b00e-97c4-47da-b270-1b8a3bfb642b => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:16.375844 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] VM Paused (Lifecycle Event)
Jun 26 03:01:16.390615 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Took 11.00 seconds to spawn the instance on the hypervisor.
Jun 26 03:01:16.390836 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:16.555378 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:16.878815 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:16.881267 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442876.881009, 80a5b00e-97c4-47da-b270-1b8a3bfb642b => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:16.881391 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] VM Resumed (Lifecycle Event)
Jun 26 03:01:16.904293 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Took 18.95 seconds to build instance.
Jun 26 03:01:17.058246 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-343c3a87-090a-40ff-b951-5e0394d152df req-d63653e2-e73d-4143-85d9-fa1959448df2 service nova] Releasing lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:17.059183 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:17.059415 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 03:01:17.383590 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:17.386512 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:01:17.405800 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-0ee1969f-5f1b-4629-a051-da54785f5155 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.454s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:17.501854 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:17.621991 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:01:17.801826 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:17.933868 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updating instance_info_cache with network_info: [{"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:18.226283 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 03:01:18.228050 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 03:01:18.228357 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Creating image(s)
Jun 26 03:01:18.228754 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 03:01:18.228961 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Ensure instance console log exists: /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 03:01:18.229196 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:18.229396 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:18.229594 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:18.436225 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:18.436463 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance network_info: |[{"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 03:01:18.437260 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Start _get_guest_xml network_info=[{"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '64b42e51-1b9c-473c-b7ae-390075d68e48', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2c8e66bf-6460-4e44-8f88-e9faa5ff07ad', 'attached_at': '', 'detached_at': '', 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'serial': '10dc4c0c-5316-4070-8ee7-9096c25e30ea'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 03:01:18.441449 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:01:18.443236 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1766275141', uuid='2c8e66bf-6460-4e44-8f88-e9faa5ff07ad'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442878.4423885) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 03:01:18.444989 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 03:01:18.445635 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 03:01:18.450256 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 03:01:18.450492 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 03:01:18.451669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 03:01:18.452006 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 03:01:18.452132 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 03:01:18.452605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 03:01:18.452605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 03:01:18.452605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 03:01:18.452605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 03:01:18.452605 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 03:01:18.452824 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 03:01:18.452824 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 03:01:18.452961 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 03:01:18.453055 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 03:01:18.463339 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 03:01:18.463697 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:01:18.463921 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:18.464293 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:18.464502 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 03:01:18.478317 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:18.478855 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:18.479144 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:01:18.479932 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:18.480523 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:18.480732 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:01:18.492141 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:01:18.492141 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:18.499936 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:01:18.499936 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea] added
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:18.509373 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:18.509923 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:01:18.509923 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:01:18.510340 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea] added
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:01:18.517006 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:18.517343 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:01:18.517664 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:01:18.517900 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:01:18.643541 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-changed-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:18.643636 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Refreshing instance network info cache due to event network-changed-55245f97-2a1c-4c13-902c-dd12fbf92863. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:01:18.643819 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] Acquiring lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:18.643918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] Acquired lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:18.644101 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Refreshing network info cache for port 55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:01:19.146277 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260]
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260] successful.
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.108329 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('9', '-', '-', 0) found on session 227 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updated VIF entry in instance network info cache for port 55245f97-2a1c-4c13-902c-dd12fbf92863. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:01:20.114210 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updating instance_info_cache with network_info: [{"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:20.206072 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-e4e4ed51-494b-4f75-bbc5-4e713a7f8afc req-0f772c7e-ac40-4ec3-bef8-cda9529b9df6 service nova] Releasing lock "refresh_cache-80a5b00e-97c4-47da-b270-1b8a3bfb642b" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:20.638151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260]
Jun 26 03:01:20.638151 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260] successful.
Jun 26 03:01:20.638151 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.649739 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:20.666801 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.666801 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.666801 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.666801 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.666801 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:20.667067 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.667067 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:20.667067 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.667067 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:20.667067 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:20.667347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.188s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:20.667547 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:01:20.668587 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:01:20.668793 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:01:20.683843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:01:20.684144 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:01:20.959490 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:21.508223 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 03:01:22.501410 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:22.524620 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799233 for multipath device dm-1 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:01:22.525177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.061s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:22.525177 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (4061ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799233', 'path': '/dev/dm-1', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799233'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:01:22.525323 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799233', 'path': '/dev/dm-1', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799233'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:01:23.031036 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1766275141',display_name='tempest-TestVolumeBootPattern-server-1766275141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1766275141',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-dfitj2w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:01:15Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=2c8e66bf-6460-4e44-8f88-e9faa5ff07ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:01:23.031328 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:01:23.031881 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:01:23.032637 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <uuid>2c8e66bf-6460-4e44-8f88-e9faa5ff07ad</uuid>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <name>instance-00000050</name>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1766275141</nova:name>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 03:01:18</nova:creationTime>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         <nova:port uuid="860fcdbe-c30d-4dbe-a12b-e6642344bd1f">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="serial">2c8e66bf-6460-4e44-8f88-e9faa5ff07ad</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="uuid">2c8e66bf-6460-4e44-8f88-e9faa5ff07ad</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/disk.config"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <alias name="ua-10dc4c0c-5316-4070-8ee7-9096c25e30ea"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-1"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <serial>10dc4c0c-5316-4070-8ee7-9096c25e30ea</serial>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:65:d2:30"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <target dev="tap860fcdbe-c3"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/console.log" append="off"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:01:23.535508 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Preparing to wait for external event network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1766275141',display_name='tempest-TestVolumeBootPattern-server-1766275141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1766275141',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-dfitj2w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:01:15Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=2c8e66bf-6460-4e44-8f88-e9faa5ff07ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:23.539108 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:01:23.539680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.539680 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '971cca53-f5ee-5e18-883b-8a40b2c0b735', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:23.540546 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.541608 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:23.542898 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.545800 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.546025 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap860fcdbe-c3, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:23.546398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap860fcdbe-c3, col_values=(('qos', UUID('2f2da077-fecf-49f3-94e0-6f59d083cded')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:23.546645 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap860fcdbe-c3, col_values=(('external_ids', {'iface-id': '860fcdbe-c30d-4dbe-a12b-e6642344bd1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:d2:30', 'vm-uuid': '2c8e66bf-6460-4e44-8f88-e9faa5ff07ad'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:23.547627 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.549387 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:23.554887 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:23.556396 np0000003683 nova-compute[98991]: INFO os_vif [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3')
Jun 26 03:01:25.074020 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:01:25.074520 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:01:25.074520 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:65:d2:30, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:01:25.074724 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Using config drive
Jun 26 03:01:25.579835 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:25.697048 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Creating config drive at /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/disk.config
Jun 26 03:01:25.699859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxianax5t {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:01:25.758005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxianax5t" returned: 0 in 0.058s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:01:26.175916 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:26.197061 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:26.304325 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:26.392056 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f88b47da-c78a-4a25-9411-52d890553bbf req-36faa988-877c-43fc-a572-f32f8f93c349 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:26.392949 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f88b47da-c78a-4a25-9411-52d890553bbf req-36faa988-877c-43fc-a572-f32f8f93c349 service nova] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:26.393171 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f88b47da-c78a-4a25-9411-52d890553bbf req-36faa988-877c-43fc-a572-f32f8f93c349 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:26.393354 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f88b47da-c78a-4a25-9411-52d890553bbf req-36faa988-877c-43fc-a572-f32f8f93c349 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:26.393822 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f88b47da-c78a-4a25-9411-52d890553bbf req-36faa988-877c-43fc-a572-f32f8f93c349 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Processing event network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:01:26.523804 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:26.542506 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:26.927606 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442886.9271634, 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:26.927791 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] VM Started (Lifecycle Event)
Jun 26 03:01:26.929437 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:01:26.934503 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:01:26.935848 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance spawned successfully.
Jun 26 03:01:26.936295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:01:27.431295 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:27.434201 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:01:27.443933 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.444338 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.445153 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.445363 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.445622 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.446002 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:01:27.504004 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:27.936335 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:01:27.937839 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442887.9366128, 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:27.937839 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] VM Paused (Lifecycle Event)
Jun 26 03:01:27.951780 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Took 9.73 seconds to spawn the instance on the hypervisor.
Jun 26 03:01:27.952053 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:28.440730 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:28.442423 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442888.442149, 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:01:28.442796 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] VM Resumed (Lifecycle Event)
Jun 26 03:01:28.450360 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:28.450418 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:28.450652 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:28.451374 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:28.451535 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] No waiting events found dispatching network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:28.451684 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-543639a4-dfe7-4168-8128-75e5d317a6f8 req-1d25a2c7-a385-4f3d-b25e-72b103d84dfb service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received unexpected event network-vif-plugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f for instance with vm_state active and task_state None.
Jun 26 03:01:28.463451 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Took 16.76 seconds to build instance.
Jun 26 03:01:28.548999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:28.946495 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:01:28.948175 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:01:28.965156 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-c90b2ad9-59c1-4178-8c4e-7fd582d78c78 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.264s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:29.457835 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-changed-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:29.458292 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Refreshing instance network info cache due to event network-changed-860fcdbe-c30d-4dbe-a12b-e6642344bd1f. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:01:29.458292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] Acquiring lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:01:29.458292 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] Acquired lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:01:29.458550 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Refreshing network info cache for port 860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:01:29.960184 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:30.275408 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:30.432120 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updated VIF entry in instance network info cache for port 860fcdbe-c30d-4dbe-a12b-e6642344bd1f. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:01:30.432422 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updating instance_info_cache with network_info: [{"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:30.934501 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-7f067914-39a9-4404-a3c3-77714cbcd7ce req-e5822cef-bbe1-487c-b408-9ae4e8a27c89 service nova] Releasing lock "refresh_cache-2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:01:32.504611 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:33.550778 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:37.506197 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:38.552715 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:42.507468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:43.554638 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:47.508220 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:48.556621 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:52.511869 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:53.566599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:55.529326 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:55.529826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:55.529826 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:55.529938 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:55.530051 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:55.532267 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Terminating instance
Jun 26 03:01:56.036239 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:01:56.052970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.071927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.071927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.082422 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.089582 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.251552 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:56.252108 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:56.252299 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:56.252446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:56.252628 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:56.252866 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6584d62b-2fad-4474-b033-da322276f732 req-dbf19679-4d88-4844-a193-51ce5b3bdb63 service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:01:56.430792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.430792 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.494955 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.497625 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.520501 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.523586 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999532900999839 future=<Future at 0x72e27c1b77a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:56.527295 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.995979617000103 future=<Future at 0x72e27c1b77a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:56.527295 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.995759668000119 future=<Future at 0x72e27c1b77a0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:01:56.528850 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Instance destroyed successfully.
Jun 26 03:01:56.529380 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lazy-loading 'resources' on Instance uuid 80a5b00e-97c4-47da-b270-1b8a3bfb642b {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:01:56.821030 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.823660 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.955204 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:56.956328 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.031885 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T03:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1768750300',display_name='tempest-TestEncryptedCinderVolumes-server-1768750300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testencryptedcindervolumes-server-1768750300',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyA6BDLYC+FgbbhOX+R5NNFyGgjF16NBfmol7LKEu9gD/82hDTs4uGoekZVDgw+0pk053uQDx1k7/HLe8jJo38tEOwwYvbslVN+lHj6ISTo8Ghr3Uk1fvwBQHeM7/RNQ==',key_name='tempest-TestEncryptedCinderVolumes-598516058',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:01:16Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc75731d341143958b1030ac806f2343',ramdisk_id='',reservation_id='r-ahpxfxbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1323610914',owner_user_name='tempest-TestEncryptedCinderVolumes-1323610914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:01:16Z,user_data=None,user_id='209bf2f2739a4be69e4ecbddb9411821',uuid=80a5b00e-97c4-47da-b270-1b8a3bfb642b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:01:57.032136 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converting VIF {"id": "55245f97-2a1c-4c13-902c-dd12fbf92863", "address": "fa:16:3e:25:b7:f9", "network": {"id": "7de6f2aa-33db-4c53-9e5c-be35b389e9cb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1754550785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc75731d341143958b1030ac806f2343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55245f97-2a", "ovs_interfaceid": "55245f97-2a1c-4c13-902c-dd12fbf92863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:01:57.032692 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:01:57.033032 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:01:57.034251 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.034521 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55245f97-2a, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:57.038356 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:57.039018 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.039180 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f683b2b-73c9-4f81-9ca3-a4ce158e255f) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:01:57.041585 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:01:57.043299 np0000003683 nova-compute[98991]: INFO os_vif [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:f9,bridge_name='br-int',has_traffic_filtering=True,id=55245f97-2a1c-4c13-902c-dd12fbf92863,network=Network(7de6f2aa-33db-4c53-9e5c-be35b389e9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55245f97-2a')
Jun 26 03:01:57.098344 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:01:57.098595 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:01:57.098790 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:01:57.099377 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:01:57.099911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:01:57.100060 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:01:57.101315 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsi session list stdout=tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4 (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '225'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '226'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '228')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '226')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4', '225')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c3a3740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'): ({'sdb'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:01:57.162533 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Flush multipath device 330000000b815ccd6 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:01:57.163427 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.269218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:01:57.269218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:01:57.269218 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:57.275430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:01:57.275430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:01:57.275430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:01:57.326854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:01:57.326854 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:01:57.330717 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.385375 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.40.100,3260]
Jun 26 03:01:57.385375 np0000003683 nova-compute[98991]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.40.100,3260] successful.
Jun 26 03:01:57.385375 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.451149 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.472768 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.488222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.50.100,3260]
Jun 26 03:01:57.488222 np0000003683 nova-compute[98991]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-ba9f5c12-7857-42f8-ab4f-eb0b013ab8a4, portal: 192.168.50.100,3260] successful.
Jun 26 03:01:57.488222 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.503991 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:01:57.505182 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:01:57.505337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] <== disconnect_volume: return (406ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:01:57.505526 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:01:57.505794 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Deleting instance files /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b_del
Jun 26 03:01:57.506379 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Deletion of /opt/stack/data/nova/instances/80a5b00e-97c4-47da-b270-1b8a3bfb642b_del complete
Jun 26 03:01:57.514982 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:01:58.013642 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Took 1.98 seconds to destroy the instance on the hypervisor.
Jun 26 03:01:58.014351 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:01:58.014989 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:01:58.015141 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:01:58.015401 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:58.086139 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:01:58.439535 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.439883 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:58.440036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:58.440295 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:58.441406 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:58.441572 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:01:58.441711 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.441870 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:58.442168 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:58.442366 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:58.442548 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:58.442664 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received unexpected event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with vm_state active and task_state deleting.
Jun 26 03:01:58.442859 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.442969 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:58.443228 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:58.443353 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:58.443723 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:58.443874 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received unexpected event network-vif-plugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with vm_state active and task_state deleting.
Jun 26 03:01:58.444009 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.444149 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:58.444286 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:58.444403 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:58.444563 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:58.444679 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:01:58.444804 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.444968 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Acquiring lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:01:58.445111 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:01:58.445231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:01:58.445370 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] No waiting events found dispatching network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:01:58.445508 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-3036b98c-4dd2-48a0-9b96-c85ab5e1f47f req-4c4d5eb1-570c-4aae-89e3-6d157baead7a service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-unplugged-55245f97-2a1c-4c13-902c-dd12fbf92863 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:01:58.598295 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-95f28ef5-1aba-4297-abe4-2d17a3d653e3 req-382ca605-f322-4092-805a-963b42e7c09c service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Received event network-vif-deleted-55245f97-2a1c-4c13-902c-dd12fbf92863 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:01:58.598657 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-95f28ef5-1aba-4297-abe4-2d17a3d653e3 req-382ca605-f322-4092-805a-963b42e7c09c service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Neutron deleted interface 55245f97-2a1c-4c13-902c-dd12fbf92863; detaching it from the instance and deleting it from the info cache
Jun 26 03:01:58.600617 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-95f28ef5-1aba-4297-abe4-2d17a3d653e3 req-382ca605-f322-4092-805a-963b42e7c09c service nova] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Detach interface failed, port_id=55245f97-2a1c-4c13-902c-dd12fbf92863, reason: Instance 80a5b00e-97c4-47da-b270-1b8a3bfb642b could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:01:59.036692 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:01:59.343979 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:01:59.344434 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:01:59.538810 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Took 1.52 seconds to deallocate network for instance.
Jun 26 03:02:00.092489 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 03:02:00.599570 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:00.599726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:00.744445 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:02:00.744791 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:02:01.247824 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:02:01.343950 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:01.755686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.156s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:01.820307 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Deleted allocations for instance 80a5b00e-97c4-47da-b270-1b8a3bfb642b
Jun 26 03:02:01.849036 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:01.849203 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:01.849327 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:01.849459 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:02:02.042275 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:02.514299 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:02.829017 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-e143201a-f6da-4bf6-aa97-854e5ea04123 tempest-TestEncryptedCinderVolumes-1323610914 tempest-TestEncryptedCinderVolumes-1323610914-project-member] Lock "80a5b00e-97c4-47da-b270-1b8a3bfb642b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.299s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:02.871037 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:02:02.873426 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:02:02.875024 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:02:02.930370 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:02:02.930945 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51629MB free_disk=71.6769790649414GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:02:02.931202 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:02.931558 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:03.991967 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:02:03.992337 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:02:03.992337 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:02:02 up 48 min,  2 users,  load average: 2.70, 3.87, 4.36\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'io_workload': '0'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:02:04.080352 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:02:04.080628 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:02:04.583340 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:02:05.091015 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:02:05.091442 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.160s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:05.091585 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:06.091610 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:06.092200 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:06.092568 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:06.092757 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:02:06.093076 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.25 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:06.821293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:06.821513 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:06.821740 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:06.821898 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:06.822021 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:06.824376 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Terminating instance
Jun 26 03:02:07.045790 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.328880 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:02:07.341521 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:07.342021 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:07.349886 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.355249 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.368599 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.375326 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.398165 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.515710 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.581519 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:07.581726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:07.581921 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:07.582231 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:07.582442 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] No waiting events found dispatching network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:02:07.582578 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-027f61bb-97f8-414e-9d13-2e24a51dc424 req-1ed7e37a-50d8-46ae-8f8b-4f009e225e77 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:02:07.645395 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.654651 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:07.672299 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999592742000004 future=<Future at 0x72e27c2cf680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:07.677261 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Instance destroyed successfully.
Jun 26 03:02:07.677966 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:02:07.747595 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:08.181698 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T03:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1766275141',display_name='tempest-TestVolumeBootPattern-server-1766275141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1766275141',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:01:27Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-dfitj2w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:01:28Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=2c8e66bf-6460-4e44-8f88-e9faa5ff07ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:02:08.182002 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "address": "fa:16:3e:65:d2:30", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap860fcdbe-c3", "ovs_interfaceid": "860fcdbe-c30d-4dbe-a12b-e6642344bd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:02:08.182587 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:02:08.182849 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:02:08.184076 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.184334 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap860fcdbe-c3, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:08.185539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.186536 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:02:08.187288 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.187455 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f2da077-fecf-49f3-94e0-6f59d083cded) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:08.188017 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.188634 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.190649 np0000003683 nova-compute[98991]: INFO os_vif [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d2:30,bridge_name='br-int',has_traffic_filtering=True,id=860fcdbe-c30d-4dbe-a12b-e6642344bd1f,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860fcdbe-c3')
Jun 26 03:02:08.192051 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:02:08.192337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:02:08.192463 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:02:08.192837 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:02:08.193160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:02:08.193339 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:02:08.215911 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:08.215911 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:08.215911 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:02:08.216095 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:08.216095 np0000003683 nova-compute[98991]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:08.216095 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:02:08.216160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '228')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:02:08.216214 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '228')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:02:08.216950 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '227')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:02:08.217493 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c25cea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'): ({'sdd'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:02:08.217689 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:02:08.217901 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000c2219a77 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:02:08.279154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:02:08.335199 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:02:08.385357 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:02:08.385586 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:02:08.386394 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:02:08.398740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:02:08.399034 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:02:08.414769 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.486720 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:08.488791 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260]
Jun 26 03:02:08.488791 np0000003683 nova-compute[98991]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260] successful.
Jun 26 03:02:08.488791 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.500303 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.511780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.554767 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260]
Jun 26 03:02:08.554767 np0000003683 nova-compute[98991]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260] successful.
Jun 26 03:02:08.554767 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.565160 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:08.565495 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:02:08.565744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (372ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:02:08.565918 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:02:08.566677 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Deleting instance files /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad_del
Jun 26 03:02:08.567261 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Deletion of /opt/stack/data/nova/instances/2c8e66bf-6460-4e44-8f88-e9faa5ff07ad_del complete
Jun 26 03:02:09.074546 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Took 1.75 seconds to destroy the instance on the hypervisor.
Jun 26 03:02:09.075275 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:02:09.075690 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:02:09.075852 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:02:09.076239 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:09.183378 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:09.343909 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:09.344382 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:09.662216 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:09.663039 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] Acquiring lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:09.663342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:09.663537 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:09.663830 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] No waiting events found dispatching network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:02:09.664018 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-82df0797-a422-4f66-a58f-55275ed08f11 req-fa90e6e7-e054-462b-8ae5-6dd54586a5c0 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-unplugged-860fcdbe-c30d-4dbe-a12b-e6642344bd1f for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:02:10.153343 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:02:10.344465 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:10.345338 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:10.404414 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:10.655657 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Took 1.58 seconds to deallocate network for instance.
Jun 26 03:02:11.216906 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 03:02:11.523313 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.00048044000004665577 future=<Future at 0x72e27c1b77a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:11.524653 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442916.5226786, 80a5b00e-97c4-47da-b270-1b8a3bfb642b => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:02:11.524904 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:11.525150 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] VM Stopped (Lifecycle Event)
Jun 26 03:02:11.525347 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.146603029000289 future=<Future at 0x72e27c2cf680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:11.525347 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=11.146485840999958 future=<Future at 0x72e27c2cf680 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:11.722141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:11.722328 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:11.725048 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-810c57d8-5a89-44c9-9826-4bb4ca740212 req-df586e35-9947-4796-a7aa-099420434da3 service nova] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Received event network-vif-deleted-860fcdbe-c30d-4dbe-a12b-e6642344bd1f {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:11.842208 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:02:11.842489 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:02:12.027939 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-4b43fd85-0434-4906-b2c8-9768ca5cd855 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 80a5b00e-97c4-47da-b270-1b8a3bfb642b] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:12.345583 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:02:12.854054 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.131s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:12.911182 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad
Jun 26 03:02:13.189719 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:13.920397 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-8d658731-2f29-4c75-bcef-1061f96898bc tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "2c8e66bf-6460-4e44-8f88-e9faa5ff07ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.099s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:14.340448 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:02:14.340720 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:02:15.980760 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:15.981329 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:16.482989 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 03:02:17.033503 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:17.033943 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:17.037315 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 03:02:17.037457 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Claim successful on node np0000003683
Jun 26 03:02:18.132931 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:02:18.133308 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:02:18.191850 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:18.635810 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:02:19.144008 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.110s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:19.144471 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 03:02:19.650908 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 03:02:19.652279 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 03:02:19.652726 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:19.653330 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:19.735715 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 03:02:20.155594 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 03:02:20.185374 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Successfully created port: d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 03:02:20.654536 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Successfully updated port: d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 03:02:20.658687 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 03:02:20.708544 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:20.708694 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing instance network info cache due to event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:02:20.708918 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] Acquiring lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:02:20.709141 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] Acquired lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:02:20.709185 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing network info cache for port d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:02:21.156690 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:02:21.163117 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Booting with volume 10dc4c0c-5316-4070-8ee7-9096c25e30ea at /dev/vda
Jun 26 03:02:21.207592 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:02:21.211568 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:21.219726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 03:02:21.242064 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:02:21.280523 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:02:21.294233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 03:02:21.294624 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 03:02:21.303954 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 03:02:21.304955 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246'] 
Jun 26 03:02:21.305123 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 03:02:21.305262 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 03:02:21.305576 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:02:21.305828 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating existing volume attachment record: 4c3952ff-934e-4360-aa54-31f726003a4f {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 03:02:21.420722 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:02:21.923169 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-20790318-9b64-4102-96e2-05bb8c206b09 req-0fe9d320-cae8-4836-8ad4-ac8f4517d69b service nova] Releasing lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:02:21.923805 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:02:21.924000 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 03:02:22.485627 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:02:22.672556 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005439940000542265 future=<Future at 0x72e27c2cf680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:22.673286 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782442927.671768, 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:02:22.673593 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:02:22.673861 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] VM Stopped (Lifecycle Event)
Jun 26 03:02:22.678269 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:22.811072 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating instance_info_cache with network_info: [{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:02:23.181411 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-eb45d637-477c-4925-b88b-d13aa96c9399 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 2c8e66bf-6460-4e44-8f88-e9faa5ff07ad] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:23.193466 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:23.313233 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:02:23.313623 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance network_info: |[{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 03:02:23.416895 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 03:02:23.418222 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 03:02:23.418523 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Creating image(s)
Jun 26 03:02:23.418858 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 03:02:23.419057 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 03:02:23.419342 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:23.419584 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:23.419754 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:23.420349 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Start _get_guest_xml network_info=[{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4c3952ff-934e-4360-aa54-31f726003a4f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1fa40047-5802-4eb4-85c4-6648e5c19f45', 'attached_at': '', 'detached_at': '', 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'serial': '10dc4c0c-5316-4070-8ee7-9096c25e30ea'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 03:02:23.423356 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:02:23.424646 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1884803834', uuid='1fa40047-5802-4eb4-85c4-6648e5c19f45'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782442943.4242718) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 03:02:23.425872 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 03:02:23.426223 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 03:02:23.427314 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 03:02:23.427960 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 03:02:23.428601 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 03:02:23.429075 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 03:02:23.429263 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 03:02:23.429415 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 03:02:23.429616 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 03:02:23.429747 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 03:02:23.429890 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 03:02:23.430113 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 03:02:23.430263 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 03:02:23.430425 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 03:02:23.430589 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 03:02:23.430759 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 03:02:23.440008 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 03:02:23.440330 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:02:23.440518 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:02:23.440938 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:02:23.441203 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 03:02:23.453471 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:02:23.454450 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:02:23.454990 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:02:23.455197 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:02:23.455744 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:02:23.455969 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:02:23.466498 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:02:23.466498 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:23.472546 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:02:23.472546 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea] added
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:02:23.480356 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:23.480674 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:02:23.480786 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:02:23.480969 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea] added
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:02:23.488053 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:23.488702 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:02:23.488702 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:02:23.488702 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:02:24.481509 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:02:24.489159 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:02:24.495347 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:02:24.503726 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:24.510332 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:24.517090 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:24.522608 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:02:24.522608 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:02:24.522832 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:02:24.522832 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:02:24.523008 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 03:02:24.523008 np0000003683 nova-compute[98991]: 
Jun 26 03:02:24.530119 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:02:24.530119 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:02:24.530267 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 26 03:02:24.530267 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:02:24.530419 np0000003683 nova-compute[98991]: WARNING os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 26 03:02:24.530419 np0000003683 nova-compute[98991]: 
Jun 26 03:02:25.562451 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260]
Jun 26 03:02:25.562451 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260] successful.
Jun 26 03:02:25.562451 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:25.563190 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260]
Jun 26 03:02:25.563190 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260] successful.
Jun 26 03:02:25.563190 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:25.576128 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:25.581965 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:02:25.592218 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.592218 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.592218 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:02:25.592448 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.592448 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.592448 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:02:25.592692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.138s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:02:25.592800 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:02:25.593558 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('7', '-', '-', 0) found on session 229 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:02:25.593715 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:02:25.599683 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.599683 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.599683 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:02:25.599844 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.599844 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:02:25.599844 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:02:25.600151 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.145s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:02:25.600285 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:02:25.600863 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('8', '-', '-', 0) found on session 230 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:02:25.601004 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:02:25.610388 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 229 and hctl ['7', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:02:25.618707 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:02:26.611252 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 229 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:02:26.611780 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:02:26.618324 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:02:26.618488 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:02:27.456188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 26 03:02:28.194927 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:28.473750 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 330000000c2219a77 for multipath device dm-0 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:02:28.474110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 5.033s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:02:28.474263 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (5033ms) {'type': 'block', 'scsi_wwn': '330000000c2219a77', 'path': '/dev/dm-0', 'multipath_id': '330000000c2219a77'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:02:28.474390 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c2219a77', 'path': '/dev/dm-0', 'multipath_id': '330000000c2219a77'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:02:28.980295 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884803834',display_name='tempest-TestVolumeBootPattern-server-1884803834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1884803834',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-tzdxowlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:02:21Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=1fa40047-5802-4eb4-85c4-6648e5c19f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:02:28.980564 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:02:28.981379 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:02:28.982190 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa40047-5802-4eb4-85c4-6648e5c19f45 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <uuid>1fa40047-5802-4eb4-85c4-6648e5c19f45</uuid>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <name>instance-00000051</name>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1884803834</nova:name>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 03:02:23</nova:creationTime>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         <nova:port uuid="d9acd27e-d89d-43f0-9e3d-194175b20c23">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="serial">1fa40047-5802-4eb4-85c4-6648e5c19f45</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="uuid">1fa40047-5802-4eb4-85c4-6648e5c19f45</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/disk.config"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <alias name="ua-10dc4c0c-5316-4070-8ee7-9096c25e30ea"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-0"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <serial>10dc4c0c-5316-4070-8ee7-9096c25e30ea</serial>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:44:ca:a4"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <target dev="tapd9acd27e-d8"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/console.log" append="off"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:02:29.485649 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Preparing to wait for external event network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884803834',display_name='tempest-TestVolumeBootPattern-server-1884803834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1884803834',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-tzdxowlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:02:21Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=1fa40047-5802-4eb4-85c4-6648e5c19f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:02:29.488837 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.489318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:29.489359 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:02:29.490296 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.490468 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4f80a62-b2e5-58c5-8e13-685305f20f4e', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:29.491298 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.492248 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:02:29.494199 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.494340 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9acd27e-d8, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:29.494706 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9acd27e-d8, col_values=(('qos', UUID('a606070b-62f4-40a6-b863-68c9c7d5fb15')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:29.494894 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9acd27e-d8, col_values=(('external_ids', {'iface-id': 'd9acd27e-d89d-43f0-9e3d-194175b20c23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ca:a4', 'vm-uuid': '1fa40047-5802-4eb4-85c4-6648e5c19f45'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:02:29.495813 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.497235 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:02:29.503435 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:29.504783 np0000003683 nova-compute[98991]: INFO os_vif [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8')
Jun 26 03:02:31.024913 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:02:31.025458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:02:31.025458 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:44:ca:a4, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:02:31.025770 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Using config drive
Jun 26 03:02:31.532242 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:31.664667 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Creating config drive at /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/disk.config
Jun 26 03:02:31.668429 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdh6jqorw {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:02:31.728144 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdh6jqorw" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:02:32.118207 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.138838 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.141398 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.248330 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.252771 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.291073 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4e1c3058-86a9-49b1-9cbc-41cc4805a619 req-8a3bd549-2692-43f0-b04b-95751ecabcdb service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:32.291293 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e1c3058-86a9-49b1-9cbc-41cc4805a619 req-8a3bd549-2692-43f0-b04b-95751ecabcdb service nova] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:32.291459 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e1c3058-86a9-49b1-9cbc-41cc4805a619 req-8a3bd549-2692-43f0-b04b-95751ecabcdb service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:32.291704 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-4e1c3058-86a9-49b1-9cbc-41cc4805a619 req-8a3bd549-2692-43f0-b04b-95751ecabcdb service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:32.291822 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-4e1c3058-86a9-49b1-9cbc-41cc4805a619 req-8a3bd549-2692-43f0-b04b-95751ecabcdb service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Processing event network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:02:32.467539 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.469088 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.471656 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.487864 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.519594 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:32.880958 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442952.880551, 1fa40047-5802-4eb4-85c4-6648e5c19f45 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:02:32.881156 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] VM Started (Lifecycle Event)
Jun 26 03:02:32.883097 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:02:32.886678 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:02:32.890132 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance spawned successfully.
Jun 26 03:02:32.890493 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:02:33.384416 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:33.388043 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:02:33.397739 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.397968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.398361 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.398660 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.399011 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.399276 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:02:33.890439 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:02:33.890954 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442953.8907285, 1fa40047-5802-4eb4-85c4-6648e5c19f45 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:02:33.891076 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] VM Paused (Lifecycle Event)
Jun 26 03:02:33.904412 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Took 10.49 seconds to spawn the instance on the hypervisor.
Jun 26 03:02:33.904641 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:34.346792 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:34.347437 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:02:34.347755 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:02:34.348065 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:34.348629 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] No waiting events found dispatching network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:02:34.348896 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-34165435-ac76-41f3-8096-2b1ff0451308 req-0211def1-14e3-4401-b13d-4199decacc35 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received unexpected event network-vif-plugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 for instance with vm_state active and task_state None.
Jun 26 03:02:34.393309 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:34.397099 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782442954.3968844, 1fa40047-5802-4eb4-85c4-6648e5c19f45 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:02:34.397197 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] VM Resumed (Lifecycle Event)
Jun 26 03:02:34.413875 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Took 17.43 seconds to build instance.
Jun 26 03:02:34.497784 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:34.899540 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:02:34.901949 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:02:34.915380 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-2d094fa8-d77e-4527-8e29-9c990a6e0409 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.934s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:02:36.426183 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:02:36.426652 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing instance network info cache due to event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:02:36.426707 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] Acquiring lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:02:36.426817 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] Acquired lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:02:36.426987 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing network info cache for port d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:02:36.929206 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:37.246669 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:02:37.375711 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updated VIF entry in instance network info cache for port d9acd27e-d89d-43f0-9e3d-194175b20c23. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:02:37.376080 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating instance_info_cache with network_info: [{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:02:37.520512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:37.878129 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-57d9d9f5-e534-4ae0-9e91-714cc57f6a52 req-4ff2b0f5-3b0e-4d3f-b074-86bc575c4446 service nova] Releasing lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:02:39.500874 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:42.521471 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:44.503849 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:47.521971 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:49.504318 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:52.524031 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:54.507529 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:57.525943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:02:59.508238 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:00.343850 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:00.344261 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:02.530902 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:03.345140 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:03.850300 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:03.850995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:03.850995 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:03.850995 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:03:04.511418 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:04.874920 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:03:04.876684 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:03:04.877596 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:03:04.926522 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:03:04.927012 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51714MB free_disk=71.66177749633789GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:03:04.927161 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:04.927488 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:05.984909 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 1fa40047-5802-4eb4-85c4-6648e5c19f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:03:05.985354 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:03:05.985354 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:03:04 up 49 min,  2 users,  load average: 1.42, 3.29, 4.12\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '1', 'io_workload': '0'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:03:06.089066 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:03:06.089393 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:03:06.592035 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:03:07.098350 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:03:07.098809 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.171s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:07.098809 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:07.532370 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:08.098779 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:08.099249 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:08.099285 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:08.099425 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:03:08.099657 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.24 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:09.340868 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:09.385249 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:09.512921 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:10.343718 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:10.344132 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:10.344132 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 26 03:03:10.846354 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] There are 0 instances to clean {{(pid=98991) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 26 03:03:10.846669 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:11.344060 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:11.344562 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:11.846050 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 12.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:12.533950 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:14.524079 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:17.536094 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:17.717548 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:17.717766 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:18.219660 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Starting instance... {{(pid=98991) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 26 03:03:18.854853 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:18.855404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:18.858698 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98991) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 26 03:03:18.858896 np0000003683 nova-compute[98991]: INFO nova.compute.claims [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Claim successful on node np0000003683
Jun 26 03:03:19.526520 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:20.005669 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:03:20.006004 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:03:20.508560 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:03:21.017706 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.162s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:21.018178 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Start building networks asynchronously for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 26 03:03:21.524256 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Allocating IP information in the background. {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 26 03:03:21.524502 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] allocate_for_instance() {{(pid=98991) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 26 03:03:21.524764 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:21.525030 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:21.593953 np0000003683 nova-compute[98991]: DEBUG nova.policy [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199454a2a0fb47729d1397c88a5735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05570fa2a3404351b9fa2350a3ad7449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98991) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 26 03:03:22.028040 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 26 03:03:22.198077 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:22.531121 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Start building block device mappings for instance. {{(pid=98991) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 26 03:03:22.678983 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Successfully created port: 348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 26 03:03:23.036341 np0000003683 nova-compute[98991]: INFO nova.virt.block_device [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Booting with volume 748af3fa-9a54-4e45-b3bb-6276f82e36d9 at /dev/vda
Jun 26 03:03:23.137740 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003683', 'execute': None}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:03:23.137740 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.scaleio [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98991) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 26 03:03:23.143901 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): nvme version {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:03:23.191520 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] 'nvme version' failed. Not Retrying. {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] nvme not present on system {{(pid=98991) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98991) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.lightos [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Current host hostNQN  and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe44:caa4', 'fe80::d4b5:11ff:fee7:5f60'] 
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] LIGHTOS: no hostnqn found. {{(pid=98991) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:03:23.209014 np0000003683 nova-compute[98991]: DEBUG nova.virt.block_device [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating existing volume attachment record: 81601a3c-d4ae-47b6-a175-971a5be41dec {{(pid=98991) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 26 03:03:23.818627 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Successfully updated port: 348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 26 03:03:23.845927 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:03:23.846031 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98991) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 26 03:03:23.872000 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-changed-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:03:23.872133 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing instance network info cache due to event network-changed-348cf262-7153-4736-8830-024adec03998. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:03:23.872408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] Acquiring lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:03:23.872545 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] Acquired lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:03:23.872695 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing network info cache for port 348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:03:24.321118 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:03:24.347995 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:03:24.447911 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:24.447911 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:03:24.528431 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:24.658452 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:03:25.160923 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-ea44c906-a4b7-454e-b688-43f888e2f6de req-640db5f7-6f55-437d-b374-927c4fb2b3b0 service nova] Releasing lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:03:25.161528 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquired lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:03:25.161740 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Building network info cache for instance {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 26 03:03:25.734317 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance cache missing network info. {{(pid=98991) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Start spawning the instance on the hypervisor. {{(pid=98991) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Creating instance directory {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Creating image(s)
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Did not create local disks {{(pid=98991) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Ensure instance console log exists: /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/console.log {{(pid=98991) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:25.998449 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:26.092887 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:26.217359 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating instance_info_cache with network_info: [{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:03:26.719266 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Releasing lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:03:26.719567 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance network_info: |[{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98991) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 26 03:03:26.720386 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Start _get_guest_xml network_info=[{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '81601a3c-d4ae-47b6-a175-971a5be41dec', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a16442cc-82d9-4b8c-a6de-8a5a8c91ced8', 'attached_at': '', 'detached_at': '', 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'serial': '748af3fa-9a54-4e45-b3bb-6276f82e36d9'}, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}}
Jun 26 03:03:26.724645 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:03:26.725886 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1800887134', uuid='a16442cc-82d9-4b8c-a6de-8a5a8c91ced8'), owner=OwnerMeta(userid='199454a2a0fb47729d1397c88a5735d4', username='tempest-TestVolumeBootPattern-1425057934-project-member', projectid='05570fa2a3404351b9fa2350a3ad7449', projectname='tempest-TestVolumeBootPattern-1425057934'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782443006.725434) {{(pid=98991) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 26 03:03:26.727061 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V1... {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 26 03:03:26.727424 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller missing on host. {{(pid=98991) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 26 03:03:26.728614 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching host: 'np0000003683' for CPU controller through CGroups V2... {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 26 03:03:26.728812 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.host [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU controller found on host. {{(pid=98991) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 26 03:03:26.729740 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98991) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 26 03:03:26.730059 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T02:38:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 26 03:03:26.730261 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 26 03:03:26.730405 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image limits 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 26 03:03:26.730561 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flavor pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Image pref 0:0:0 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got 1 possible topologies {{(pid=98991) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.hardware [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98991) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Calling os-brick to attach iSCSI Volume {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:03:26.742974 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 26 03:03:26.756042 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:03:26.756786 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:03:26.757433 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:03:26.757686 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:03:26.758716 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:03:26.758972 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:03:26.770321 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:03:26.770321 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:26.776562 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 26 03:03:26.776562 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9] added
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:03:26.784020 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:26.784408 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:03:26.784408 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:03:26.784529 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9] added
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]: iscsiadm: Config file line 363 does not have value
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 26 03:03:26.789180 np0000003683 nova-compute[98991]:  {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:26.789535 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98991) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 26 03:03:26.789535 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 26 03:03:26.789636 np0000003683 nova-compute[98991]: DEBUG os_brick.utils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98991) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 26 03:03:27.785067 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 26 03:03:27.790867 np0000003683 nova-compute[98991]: INFO os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.40.100
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:03:27.800505 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.name = iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.tpgt = -1
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.startup = manual
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.leading_login = No
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.iscsi_ifacename = default
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.net_ifacename = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.ipaddress = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.prefix_len = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.hwaddress = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.transport_name = tcp
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.initiatorname = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.vlan_id = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.vlan_priority = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.vlan_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.iface_num = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.mtu = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.port = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.bootproto = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.subnet_mask = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.gateway = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_alt_client_id = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_dns = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_learn_iqn = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_req_vendor_id_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_vendor_id = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.dhcp_slp_da = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.fragmentation = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.gratuitous_arp = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.incoming_forwarding = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tos_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tos = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.ttl = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.delayed_ack = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tcp_nagle = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tcp_wsf_state = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tcp_wsf = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tcp_timer_scale = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.tcp_timestamp = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.redirect = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.def_task_mgmt_timeout = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.header_digest = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.data_digest = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.immediate_data = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.initial_r2t = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.data_seq_inorder = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.data_pdu_inorder = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.erl = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.max_receive_data_len = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.first_burst_len = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.max_outstanding_r2t = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.max_burst_len = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.chap_auth = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.bidi_chap = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.strict_login_compliance = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.discovery_auth = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: iface.discovery_logout = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.discovery_address = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.discovery_port = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.discovery_type = fw
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.initial_cmdsn = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.initial_login_retry_max = 8
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.xmit_thread_priority = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.cmds_max = 128
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.queue_depth = 32
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.nr_sessions = 1
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.authmethod = None
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.username = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.password = ***
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.username_in = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.password_in = <empty>
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.auth.chap_algs = SHA256
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.timeo.replacement_timeout = 120
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.err_timeo.abort_timeout = 15
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.err_timeo.lu_reset_timeout = 30
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.err_timeo.host_reset_timeout = 60
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.FastAbort = Yes
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.InitialR2T = No
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.ImmediateData = Yes
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.FirstBurstLength = 262144
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.MaxBurstLength = 16776192
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Retain = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.DefaultTime2Wait = 2
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.MaxConnections = 1
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.iscsi.ERL = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.scan = auto
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.session.reopen_max = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].address = 192.168.50.100
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].port = 3260
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].startup = manual
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].tcp.window_size = 524288
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].tcp.type_of_service = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].timeo.logout_timeout = 15
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].timeo.login_timeout = 15
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].timeo.auth_timeout = 45
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_interval = 5
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].timeo.noop_out_timeout = 5
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.HeaderDigest = None
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.DataDigest = None
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.IFMarker = No
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: node.conn[0].iscsi.OFMarker = No
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]: # END RECORD
Jun 26 03:03:27.806269 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.813210 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.819080 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.825907 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.825907 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.825907 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:03:27.826112 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.826112 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.826112 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:03:27.833444 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.833444 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.833444 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:03:27.833668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.833668 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.833668 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:03:27.864208 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.40.100,3260]
Jun 26 03:03:27.864208 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.40.100,3260] successful.
Jun 26 03:03:27.864208 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.877253 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.50.100,3260]
Jun 26 03:03:27.877253 np0000003683 nova-compute[98991]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.50.100,3260] successful.
Jun 26 03:03:27.877253 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.877910 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.891260 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:03:27.896571 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.896571 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.896571 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.896571 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.896571 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:03:27.896782 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.896782 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.896782 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.896782 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.896782 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:03:27.896939 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:03:27.897082 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.40.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:03:27.897826 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('9', '-', '-', 0) found on session 231 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:03:27.897966 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:03:27.906843 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.906843 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.906843 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.906843 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.906843 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:03:27.907053 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.907053 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:03:27.907053 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.907053 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:03:27.907053 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:03:27.907315 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:03:27.907467 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to 192.168.50.100:3260 {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 26 03:03:27.908108 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] HCTL ('10', '-', '-', 0) found on session 232 with lun 0 {{(pid=98991) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 26 03:03:27.908220 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98991) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 26 03:03:27.914178 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 231 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:03:27.914439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:03:27.923439 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 232 and hctl ['10', '*', '*', 0] yield: None {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:03:28.923631 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Searching for a device in session 232 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98991) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 26 03:03:28.924070 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98991) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 26 03:03:29.531791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:29.777239 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Found WWN 3300000006ab8f75e for multipath device dm-3 {{(pid=98991) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 26 03:03:29.777491 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:03:29.777625 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000006ab8f75e', 'path': '/dev/dm-3', 'multipath_id': '3300000006ab8f75e'} {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:03:29.777732 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006ab8f75e', 'path': '/dev/dm-3', 'multipath_id': '3300000006ab8f75e'} {{(pid=98991) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 26 03:03:30.282620 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800887134',display_name='tempest-TestVolumeBootPattern-server-1800887134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1800887134',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ic7n107i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:03:23Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a16442cc-82d9-4b8c-a6de-8a5a8c91ced8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98991) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 26 03:03:30.283138 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:03:30.283365 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:03:30.283990 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'pci_devices' on Instance uuid a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] End _get_guest_xml xml=<domain type="qemu">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <uuid>a16442cc-82d9-4b8c-a6de-8a5a8c91ced8</uuid>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <name>instance-00000052</name>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <memory>196608</memory>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <vcpu>1</vcpu>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <metadata>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:package version="33.1.0"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:name>tempest-TestVolumeBootPattern-server-1800887134</nova:name>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:creationTime>2026-06-26 03:03:26</nova:creationTime>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:flavor name="m1.nano" id="42">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:memory>192</nova:memory>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:disk>1</nova:disk>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:swap>0</nova:swap>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:ephemeral>0</nova:ephemeral>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:vcpus>1</nova:vcpus>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:extraSpecs>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         </nova:extraSpecs>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       </nova:flavor>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:image uuid="">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:minDisk>1</nova:minDisk>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:minRam>0</nova:minRam>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:properties>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         </nova:properties>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       </nova:image>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:owner>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:user uuid="199454a2a0fb47729d1397c88a5735d4">tempest-TestVolumeBootPattern-1425057934-project-member</nova:user>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:project uuid="05570fa2a3404351b9fa2350a3ad7449">tempest-TestVolumeBootPattern-1425057934</nova:project>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       </nova:owner>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:root type="volume" uuid=""/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <nova:ports>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         <nova:port uuid="348cf262-7153-4736-8830-024adec03998">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:         </nova:port>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       </nova:ports>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </nova:instance>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </metadata>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <sysinfo type="smbios">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <system>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="product">OpenStack Nova</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="version">33.1.0</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="serial">a16442cc-82d9-4b8c-a6de-8a5a8c91ced8</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="uuid">a16442cc-82d9-4b8c-a6de-8a5a8c91ced8</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <entry name="family">Virtual Machine</entry>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </system>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </sysinfo>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <os>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <boot dev="hd"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <smbios mode="sysinfo"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </os>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <features>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <acpi/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <tcg>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <tb-cache unit="MiB">128</tb-cache>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </tcg>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <vmcoreinfo/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </features>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <iothreads>1</iothreads>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <clock offset="utc"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <cpu mode="custom" match="exact">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <model>Nehalem</model>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <topology sockets="1" cores="1" threads="1"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </cpu>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   <devices>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <disk type="file" device="cdrom">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <source file="/opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/disk.config"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <target dev="hda" bus="ide"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <disk type="block" device="disk">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <alias name="ua-748af3fa-9a54-4e45-b3bb-6276f82e36d9"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <source dev="/dev/dm-3"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <target dev="vda" bus="virtio"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <serial>748af3fa-9a54-4e45-b3bb-6276f82e36d9</serial>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </disk>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <interface type="ethernet">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <mac address="fa:16:3e:54:3d:c5"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <driver name="qemu"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <mtu size="1372"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <target dev="tap348cf262-71"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </interface>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <serial type="pty">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <log file="/opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/console.log" append="off"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </serial>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <video>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <model type="virtio"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </video>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <rng model="virtio">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <backend model="random">/dev/urandom</backend>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </rng>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <controller type="usb" index="0" model="none"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:       <stats period="10"/>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:     </memballoon>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:   </devices>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]: </domain>
Jun 26 03:03:30.786606 np0000003683 nova-compute[98991]:  {{(pid=98991) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Preparing to wait for external event network-vif-plugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T03:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800887134',display_name='tempest-TestVolumeBootPattern-server-1800887134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1800887134',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ic7n107i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T03:03:23Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a16442cc-82d9-4b8c-a6de-8a5a8c91ced8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:03:30.788569 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71') {{(pid=98991) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 26 03:03:30.788918 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.789159 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:03:30.789580 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 26 03:03:30.790185 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.790414 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcf9fdb0-f0e5-52c9-b3e9-1612fcc091af', '_type': 'linux-noop'}}, row=False) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:03:30.791203 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.791929 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:03:30.794060 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.794224 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348cf262-71, may_exist=True, interface_attrs={}) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:03:30.794583 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348cf262-71, col_values=(('qos', UUID('4c215dbd-bbb1-4db3-9902-b816706f89ab')),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:03:30.794751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348cf262-71, col_values=(('external_ids', {'iface-id': '348cf262-7153-4736-8830-024adec03998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:3d:c5', 'vm-uuid': 'a16442cc-82d9-4b8c-a6de-8a5a8c91ced8'}),), if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:03:30.795533 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.796643 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:03:30.801200 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:30.802199 np0000003683 nova-compute[98991]: INFO os_vif [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71')
Jun 26 03:03:32.370300 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name hda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:03:32.370760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No BDM found with device name vda, not building metadata. {{(pid=98991) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}}
Jun 26 03:03:32.370760 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] No VIF found with MAC fa:16:3e:54:3d:c5, not building metadata {{(pid=98991) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}}
Jun 26 03:03:32.370933 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Using config drive
Jun 26 03:03:32.876920 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:33.017812 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Creating config drive at /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/disk.config
Jun 26 03:03:33.020920 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9lmdpo3j {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:03:33.080583 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9lmdpo3j" returned: 0 in 0.059s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:03:33.496385 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.513158 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.514999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.602990 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.654402 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.655503 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:33.664172 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1bcb5c6a-9639-4bb6-b30f-1d94c9527dfd req-778a399f-a7bc-4121-a84c-bb5b36aee203 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-plugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:03:33.664715 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1bcb5c6a-9639-4bb6-b30f-1d94c9527dfd req-778a399f-a7bc-4121-a84c-bb5b36aee203 service nova] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:33.664944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1bcb5c6a-9639-4bb6-b30f-1d94c9527dfd req-778a399f-a7bc-4121-a84c-bb5b36aee203 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:33.665096 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-1bcb5c6a-9639-4bb6-b30f-1d94c9527dfd req-778a399f-a7bc-4121-a84c-bb5b36aee203 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:33.665214 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-1bcb5c6a-9639-4bb6-b30f-1d94c9527dfd req-778a399f-a7bc-4121-a84c-bb5b36aee203 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Processing event network-vif-plugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 26 03:03:34.223983 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782443014.2235632, a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 => Started> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:03:34.224152 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] VM Started (Lifecycle Event)
Jun 26 03:03:34.226152 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98991) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 26 03:03:34.229402 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Guest created on hypervisor {{(pid=98991) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 26 03:03:34.232262 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance spawned successfully.
Jun 26 03:03:34.232686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 26 03:03:34.727568 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:03:34.730042 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:03:34.740416 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_cdrom_bus of ide {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:34.740914 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_disk_bus of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:34.741073 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_input_bus of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:34.741333 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_pointer_model of None {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:34.741714 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_video_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:34.742046 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Found default for hw_vif_model of virtio {{(pid=98991) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 26 03:03:35.232668 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 26 03:03:35.233059 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782443015.2328572, a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 => Paused> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:03:35.233159 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] VM Paused (Lifecycle Event)
Jun 26 03:03:35.247820 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Took 9.27 seconds to spawn the instance on the hypervisor.
Jun 26 03:03:35.248043 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:03:35.720467 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-plugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:03:35.720711 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:03:35.720933 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:03:35.721068 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:35.721217 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] No waiting events found dispatching network-vif-plugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:03:35.721420 np0000003683 nova-compute[98991]: WARNING nova.compute.manager [req-d74ed450-e5a6-4b0a-b641-9fc8ee226b00 req-1f019873-598f-419b-969c-520a54deafc8 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received unexpected event network-vif-plugged-348cf262-7153-4736-8830-024adec03998 for instance with vm_state active and task_state None.
Jun 26 03:03:35.735331 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:03:35.738228 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Emitting event <LifecycleEvent: 1782443015.7379718, a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 => Resumed> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:03:35.738442 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] VM Resumed (Lifecycle Event)
Jun 26 03:03:35.758801 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Took 17.04 seconds to build instance.
Jun 26 03:03:35.796274 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:36.241371 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:03:36.243786 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98991) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 26 03:03:36.261408 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.543s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:03:37.543135 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:38.004457 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-changed-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:03:38.004457 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing instance network info cache due to event network-changed-348cf262-7153-4736-8830-024adec03998. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:03:38.004457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] Acquiring lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:03:38.004457 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] Acquired lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:03:38.004457 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing network info cache for port 348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:03:38.502224 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:38.852536 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:03:38.988864 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updated VIF entry in instance network info cache for port 348cf262-7153-4736-8830-024adec03998. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:03:38.990456 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating instance_info_cache with network_info: [{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:03:39.490935 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-cc28339c-d3e2-4a23-90b4-87acf134c52d req-0ea7cee0-6559-4ddf-be65-f9bbb4f54b5f service nova] Releasing lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:03:40.804912 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:42.541970 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:45.806819 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:47.544789 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:50.809300 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:52.545628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:55.810759 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:03:57.546498 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:00.813350 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:02.558548 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:02.846105 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:02.846398 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:04.343868 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:04.848796 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:04.848996 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:04.849116 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:04.849251 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:04:05.822544 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:05.872856 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:04:05.874860 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98991) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}}
Jun 26 03:04:05.876787 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:04:05.877751 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:04:05.928814 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:04:05.929208 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=51410MB free_disk=71.65039825439453GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:04:05.929440 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:05.929708 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:06.984815 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance 1fa40047-5802-4eb4-85c4-6648e5c19f45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:04:06.985196 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Instance a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98991) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 26 03:04:06.985196 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:04:06.985279 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:04:05 up 50 min,  2 users,  load average: 1.77, 3.10, 4.01\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_05570fa2a3404351b9fa2350a3ad7449': '2', 'io_workload': '0'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:04:07.031201 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Refreshing inventories for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 26 03:04:07.075815 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Updating ProviderTree inventory for provider af1bc8b6-4321-4361-b703-e0f6b10a10af from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 26 03:04:07.076006 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Updating inventory in ProviderTree for provider af1bc8b6-4321-4361-b703-e0f6b10a10af with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 26 03:04:07.129276 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Refreshing aggregate associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, aggregates: None {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 26 03:04:07.179191 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Refreshing trait associations for resource provider af1bc8b6-4321-4361-b703-e0f6b10a10af, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_X86_64,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_RISCV64,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ADDRESS_SPACE_EMULATED,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_LAN9118 {{(pid=98991) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 26 03:04:07.331968 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:04:07.332226 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:04:07.560936 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:07.749981 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:07.834975 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:04:08.341753 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:04:08.342283 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.412s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:08.342283 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:09.342207 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:09.342695 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:09.342695 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:09.342811 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:04:09.343005 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:10.824806 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:11.340804 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:11.341082 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:12.343844 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:12.344395 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:12.344438 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:12.560826 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:14.340620 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:04:14.341045 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:04:15.103647 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-changed-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:15.103857 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing instance network info cache due to event network-changed-348cf262-7153-4736-8830-024adec03998. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:04:15.104035 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] Acquiring lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:04:15.104126 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] Acquired lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:04:15.104262 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Refreshing network info cache for port 348cf262-7153-4736-8830-024adec03998 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:04:15.606626 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:15.634981 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:15.635131 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:15.635331 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:15.635551 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:15.635659 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:15.638557 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Terminating instance
Jun 26 03:04:15.827229 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:15.927365 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:16.141529 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:04:16.158851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.159513 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.179767 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.348259 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:16.348259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:16.348259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:16.348259 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:16.348403 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] No waiting events found dispatching network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:04:16.348709 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-c1b0f1ef-5393-4391-992a-7c9788d2bdf9 req-6570fc07-b3f2-438a-aa1a-3fdbf94276b7 service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:04:16.360492 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.366974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.456563 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.466512 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:16.506822 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999595494999994 future=<Future at 0x72e29c4da480 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:16.508387 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.997722257000078 future=<Future at 0x72e29c4da480 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:16.508387 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.997578258999965 future=<Future at 0x72e29c4da480 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:16.513979 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Instance destroyed successfully.
Jun 26 03:04:16.514752 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:04:16.602123 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updated VIF entry in instance network info cache for port 348cf262-7153-4736-8830-024adec03998. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:04:16.602594 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating instance_info_cache with network_info: [{"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:04:17.017343 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T03:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1800887134',display_name='tempest-TestVolumeBootPattern-server-1800887134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1800887134',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:03:35Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-ic7n107i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:03:35Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=a16442cc-82d9-4b8c-a6de-8a5a8c91ced8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:04:17.018019 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "348cf262-7153-4736-8830-024adec03998", "address": "fa:16:3e:54:3d:c5", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap348cf262-71", "ovs_interfaceid": "348cf262-7153-4736-8830-024adec03998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:04:17.018243 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:04:17.018504 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:04:17.020119 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.020440 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348cf262-71, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:04:17.021690 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.022427 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:04:17.022978 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.023935 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.024096 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c215dbd-bbb1-4db3-9902-b816706f89ab) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:04:17.024664 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.025169 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:04:17.025507 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.027954 np0000003683 nova-compute[98991]: INFO os_vif [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=348cf262-7153-4736-8830-024adec03998,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348cf262-71')
Jun 26 03:04:17.029837 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:04:17.030172 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:04:17.030327 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:04:17.030777 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:04:17.031110 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '748af3fa-9a54-4e45-b3bb-6276f82e36d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:04:17.031255 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:04:17.059029 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:17.059029 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:17.059029 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:04:17.059029 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:04:17.059029 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:04:17.059337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:17.059337 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:17.059337 np0000003683 nova-compute[98991]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:04:17.059337 np0000003683 nova-compute[98991]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9 (non-flash)
Jun 26 03:04:17.059337 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:04:17.059551 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', '232')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:04:17.059668 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', '231')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:04:17.060513 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9', '232')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:04:17.061233 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c6bd940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'): ({'sde'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:04:17.061424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdd, sde {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:04:17.061692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 3300000006ab8f75e {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:04:17.104735 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-37e6cd4b-ca1d-4d94-b0f6-ed1c23774e6b req-8a60b9fe-57c9-4510-9d11-021baf03d6fe service nova] Releasing lock "refresh_cache-a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:04:17.133612 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:04:17.186154 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:04:17.237097 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:04:17.237286 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:04:17.238438 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:04:17.250316 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:04:17.250645 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:04:17.262556 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.293885 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.40.100,3260]
Jun 26 03:04:17.293885 np0000003683 nova-compute[98991]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.40.100,3260] successful.
Jun 26 03:04:17.293885 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.309249 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.320933 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.353072 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.50.100,3260]
Jun 26 03:04:17.353072 np0000003683 nova-compute[98991]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-748af3fa-9a54-4e45-b3bb-6276f82e36d9, portal: 192.168.50.100,3260] successful.
Jun 26 03:04:17.353072 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.368193 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:17.368393 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:04:17.368565 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (337ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:04:17.368738 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:04:17.369034 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Deleting instance files /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8_del
Jun 26 03:04:17.369656 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Deletion of /opt/stack/data/nova/instances/a16442cc-82d9-4b8c-a6de-8a5a8c91ced8_del complete
Jun 26 03:04:17.561841 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:17.878326 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Took 1.74 seconds to destroy the instance on the hypervisor.
Jun 26 03:04:17.879089 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:04:17.879575 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:04:17.880102 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:04:17.880366 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:17.947704 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:18.416944 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:18.416944 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] Acquiring lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:18.417958 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:18.418158 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:18.418399 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] No waiting events found dispatching network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:04:18.418618 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-unplugged-348cf262-7153-4736-8830-024adec03998 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:04:18.418789 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Received event network-vif-deleted-348cf262-7153-4736-8830-024adec03998 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:18.418935 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Neutron deleted interface 348cf262-7153-4736-8830-024adec03998; detaching it from the instance and deleting it from the info cache
Jun 26 03:04:18.421352 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-f3898b95-9309-4075-9793-4f5abc5b4cb6 req-154107cd-27c1-4f18-967d-b30a974125fc service nova] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Detach interface failed, port_id=348cf262-7153-4736-8830-024adec03998, reason: Instance a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:04:18.715825 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:04:19.218168 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Took 1.34 seconds to deallocate network for instance.
Jun 26 03:04:19.773825 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Took 0.56 seconds to detach 1 volumes for instance.
Jun 26 03:04:20.280032 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:20.280166 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:20.436575 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:04:20.436775 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:04:20.939368 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:04:21.446215 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.166s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:21.504764 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance a16442cc-82d9-4b8c-a6de-8a5a8c91ced8
Jun 26 03:04:22.025690 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:22.513069 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-495501ed-fa37-47d9-9bba-3d6c5a78d72a tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "a16442cc-82d9-4b8c-a6de-8a5a8c91ced8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.878s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:24.866142 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:24.866844 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing instance network info cache due to event network-changed-d9acd27e-d89d-43f0-9e3d-194175b20c23. {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 26 03:04:24.867083 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] Acquiring lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 26 03:04:24.867232 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] Acquired lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 26 03:04:24.867399 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Refreshing network info cache for port d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 26 03:04:25.370660 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:25.402686 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:25.402859 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:25.403047 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:25.403189 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:25.403289 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:25.405513 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Terminating instance
Jun 26 03:04:25.636517 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:25.764573 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updated VIF entry in instance network info cache for port d9acd27e-d89d-43f0-9e3d-194175b20c23. {{(pid=98991) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
Jun 26 03:04:25.764844 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating instance_info_cache with network_info: [{"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:04:25.909054 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Start destroying the instance on the hypervisor. {{(pid=98991) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 26 03:04:25.925516 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:25.927269 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:25.939924 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:25.943628 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:25.960909 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.077872 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:26.078103 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:26.078340 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:26.078460 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:26.078704 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] No waiting events found dispatching network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:04:26.079166 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-710ded95-5f4e-43e6-8b74-76aa25d4cc47 req-f3561187-a68f-484b-8ef7-27cd69b5f220 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:04:26.233911 np0000003683 nova-compute[98991]: DEBUG nova.utils [None req-8234e282-c996-448e-adb6-6a359df2f426 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=14.999693066999953 future=<Future at 0x72e27c4923c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:26.236594 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Instance destroyed successfully.
Jun 26 03:04:26.237044 np0000003683 nova-compute[98991]: DEBUG nova.objects.instance [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lazy-loading 'resources' on Instance uuid 1fa40047-5802-4eb4-85c4-6648e5c19f45 {{(pid=98991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 26 03:04:26.267070 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-6f11c7d4-294d-46f8-b497-1868accc210e req-11fdb91b-168b-4760-bbb4-c914182cacb7 service nova] Releasing lock "refresh_cache-1fa40047-5802-4eb4-85c4-6648e5c19f45" {{(pid=98991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 26 03:04:26.739534 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.vif [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T03:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1884803834',display_name='tempest-TestVolumeBootPattern-server-1884803834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003683',hostname='tempest-testvolumebootpattern-server-1884803834',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQoaCeRe6yVmD18C5o6p+mlazwQpjQiC2Rhz3AO77Y7ZaxlhASai0ct+QT4yL34T2farIVvZAJPnCHSSJF83sS/ETaRmYQ+N887vbfcUakDMn4ync5nEEn0nSIuilEQvw==',key_name='tempest-TestVolumeBootPattern-1959505201',keypairs=<?>,launch_index=0,launched_at=2026-06-26T03:02:33Z,launched_on='np0000003683',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003683',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05570fa2a3404351b9fa2350a3ad7449',ramdisk_id='',reservation_id='r-tzdxowlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1425057934',owner_user_name='tempest-TestVolumeBootPattern-1425057934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-26T03:02:34Z,user_data=None,user_id='199454a2a0fb47729d1397c88a5735d4',uuid=1fa40047-5802-4eb4-85c4-6648e5c19f45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 26 03:04:26.739801 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converting VIF {"id": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "address": "fa:16:3e:44:ca:a4", "network": {"id": "8a539005-b856-46e8-a224-ad902b4141ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-891888354-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05570fa2a3404351b9fa2350a3ad7449", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9acd27e-d8", "ovs_interfaceid": "d9acd27e-d89d-43f0-9e3d-194175b20c23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 26 03:04:26.740316 np0000003683 nova-compute[98991]: DEBUG nova.network.os_vif_util [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8') {{(pid=98991) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 26 03:04:26.740546 np0000003683 nova-compute[98991]: DEBUG os_vif [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8') {{(pid=98991) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 26 03:04:26.742196 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.742469 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9acd27e-d8, bridge=br-int, if_exists=True) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:04:26.743631 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.744886 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:04:26.745464 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.745692 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a606070b-62f4-40a6-b863-68c9c7d5fb15) {{(pid=98991) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 26 03:04:26.746332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.746900 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:26.748618 np0000003683 nova-compute[98991]: INFO os_vif [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ca:a4,bridge_name='br-int',has_traffic_filtering=True,id=d9acd27e-d89d-43f0-9e3d-194175b20c23,network=Network(8a539005-b856-46e8-a224-ad902b4141ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9acd27e-d8')
Jun 26 03:04:26.750364 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] calling os-brick to detach iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 26 03:04:26.750696 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72e29c4da270>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 26 03:04:26.750835 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 26 03:04:26.751138 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 26 03:04:26.751424 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10dc4c0c-5316-4070-8ee7-9096c25e30ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 26 03:04:26.751596 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', 0)] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 26 03:04:26.774066 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:26.774066 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:26.774066 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 26 03:04:26.774287 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:26.774287 np0000003683 nova-compute[98991]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea (non-flash)
Jun 26 03:04:26.774287 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 26 03:04:26.774395 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '230')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 26 03:04:26.774474 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '229')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:04:26.775188 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea', '230')] {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 26 03:04:26.775809 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72e29c2e1940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'): ({'sdc'}, set())}) {{(pid=98991) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 26 03:04:26.775992 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Removing multipathed devices sdc, sdb {{(pid=98991) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 26 03:04:26.776222 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Flush multipath device 330000000c2219a77 {{(pid=98991) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 26 03:04:26.831400 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:04:26.873337 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98991) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 26 03:04:26.913537 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 26 03:04:26.914043 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98991) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 26 03:04:26.914692 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 26 03:04:26.927283 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.linuxscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98991) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 26 03:04:26.927430 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea')] {{(pid=98991) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 26 03:04:26.941364 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:26.979761 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260]
Jun 26 03:04:26.979761 np0000003683 nova-compute[98991]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.40.100,3260] successful.
Jun 26 03:04:26.979761 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:26.993019 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:27.005189 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:27.029611 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260]
Jun 26 03:04:27.029611 np0000003683 nova-compute[98991]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-10dc4c0c-5316-4070-8ee7-9096c25e30ea, portal: 192.168.50.100,3260] successful.
Jun 26 03:04:27.029611 np0000003683 nova-compute[98991]:  stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:27.040201 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98991) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 26 03:04:27.040412 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.base [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 26 03:04:27.040560 np0000003683 nova-compute[98991]: DEBUG os_brick.initiator.connectors.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] <== disconnect_volume: return (289ms) None {{(pid=98991) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 26 03:04:27.040686 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Disconnected iSCSI Volume {{(pid=98991) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 26 03:04:27.040914 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Deleting instance files /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45_del
Jun 26 03:04:27.041527 np0000003683 nova-compute[98991]: INFO nova.virt.libvirt.driver [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Deletion of /opt/stack/data/nova/instances/1fa40047-5802-4eb4-85c4-6648e5c19f45_del complete
Jun 26 03:04:27.547923 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Took 1.64 seconds to destroy the instance on the hypervisor.
Jun 26 03:04:27.548590 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._common.loopingcall [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98991) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 26 03:04:27.549004 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Deallocating network for instance {{(pid=98991) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 26 03:04:27.549117 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] deallocate_for_instance() {{(pid=98991) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 26 03:04:27.549334 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:27.622153 np0000003683 nova-compute[98991]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 26 03:04:27.839303 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:27.921856 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e847cb01-d430-4afe-a9a4-cf6728c44a19 req-bbbeec70-8be4-4a02-bbe7-3a90ac519a77 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-deleted-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:27.922237 np0000003683 nova-compute[98991]: INFO nova.compute.manager [req-e847cb01-d430-4afe-a9a4-cf6728c44a19 req-bbbeec70-8be4-4a02-bbe7-3a90ac519a77 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Neutron deleted interface d9acd27e-d89d-43f0-9e3d-194175b20c23; detaching it from the instance and deleting it from the info cache
Jun 26 03:04:27.923905 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-e847cb01-d430-4afe-a9a4-cf6728c44a19 req-bbbeec70-8be4-4a02-bbe7-3a90ac519a77 service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Detach interface failed, port_id=d9acd27e-d89d-43f0-9e3d-194175b20c23, reason: Instance 1fa40047-5802-4eb4-85c4-6648e5c19f45 could not be found. {{(pid=98991) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 26 03:04:28.140813 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 26 03:04:28.141005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] Acquiring lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:28.141153 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:28.141285 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:28.141448 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] No waiting events found dispatching network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 {{(pid=98991) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 26 03:04:28.141539 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [req-b0641cd9-3e76-484b-bfa0-375a4f3f25bb req-dfbad64c-6657-46e9-832d-e1abbf1774ae service nova] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Received event network-vif-unplugged-d9acd27e-d89d-43f0-9e3d-194175b20c23 for instance with task_state deleting. {{(pid=98991) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 26 03:04:28.371168 np0000003683 nova-compute[98991]: DEBUG nova.network.neutron [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Updating instance_info_cache with network_info: [] {{(pid=98991) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 26 03:04:28.873371 np0000003683 nova-compute[98991]: INFO nova.compute.manager [-] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Took 1.32 seconds to deallocate network for instance.
Jun 26 03:04:29.425407 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Took 0.55 seconds to detach 1 volumes for instance.
Jun 26 03:04:29.931005 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:04:29.931169 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:04:30.042881 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:04:30.043102 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:04:30.546142 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:04:31.054122 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.123s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:31.115603 np0000003683 nova-compute[98991]: INFO nova.scheduler.client.report [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Deleted allocations for instance 1fa40047-5802-4eb4-85c4-6648e5c19f45
Jun 26 03:04:31.506364 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0004534849999799917 future=<Future at 0x72e29c4da480 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:31.507065 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Emitting event <LifecycleEvent: 1782443056.505761, a16442cc-82d9-4b8c-a6de-8a5a8c91ced8 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:04:31.507301 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:31.507573 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] VM Stopped (Lifecycle Event)
Jun 26 03:04:31.508840 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=9.724762578000082 future=<Future at 0x72e27c4923c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:31.508996 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=9.72455294700012 future=<Future at 0x72e27c4923c0 state=pending>) {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:31.747100 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:32.010596 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-3b6f0779-471b-4008-8a69-6048a29b89af tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] [instance: a16442cc-82d9-4b8c-a6de-8a5a8c91ced8] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:04:32.124505 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-242194b2-f7fb-48c8-8f92-00ed876bfe94 tempest-TestVolumeBootPattern-1425057934 tempest-TestVolumeBootPattern-1425057934-project-member] Lock "1fa40047-5802-4eb4-85c4-6648e5c19f45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.721s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:04:35.200310 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:36.748149 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:36.887935 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:41.234294 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x72e2ac2556a0>>, remaining_delay=-0.0005572699997173913 future=<Future at 0x72e27c4923c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x72e2ac21c950> {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:41.235379 np0000003683 nova-compute[98991]: DEBUG nova.virt.driver [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] Emitting event <LifecycleEvent: 1782443066.2334986, 1fa40047-5802-4eb4-85c4-6648e5c19f45 => Stopped> {{(pid=98991) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 26 03:04:41.235684 np0000003683 nova-compute[98991]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98991) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 26 03:04:41.235874 np0000003683 nova-compute[98991]: INFO nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] VM Stopped (Lifecycle Event)
Jun 26 03:04:41.738570 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-d2d821b1-aa36-448d-8975-4877c859f1f9 tempest-SnapshotDataIntegrityTests-1423257265 tempest-SnapshotDataIntegrityTests-1423257265-project-member] [instance: 1fa40047-5802-4eb4-85c4-6648e5c19f45] Checking state {{(pid=98991) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 26 03:04:41.750859 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:46.752992 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:51.754353 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:04:56.756205 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:01.758734 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:02.343736 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:02.344086 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:04.344083 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:04.849097 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:05:04.849252 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:05:04.849404 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:05:04.849520 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:05:04.862123 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:05:04.863446 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:05:04.910043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:05:04.910529 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=52236MB free_disk=71.6295394897461GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:05:04.910726 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:05:04.911043 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:05:05.971351 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:05:05.971942 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:05:04 up 51 min,  1 user,  load average: 1.33, 2.74, 3.83\n'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:05:06.027801 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:05:06.028169 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:05:06.531010 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:05:06.765974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:06.765974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:06.765974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:05:06.765974 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:06.766298 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:06.766420 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:07.037310 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:05:07.037977 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.126s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:05:07.037977 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:08.037981 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:08.038430 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:08.038430 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:05:08.038667 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.30 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:08.344294 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:08.344734 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:11.340523 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:11.341081 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:11.767447 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:12.343856 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:12.344404 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:05:12.344404 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:05:16.767713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:16.768133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:16.768133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:05:16.768133 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:16.768332 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:16.768496 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:21.773990 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:21.774584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:21.774584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:05:21.774584 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:21.776416 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:21.776595 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:26.781845 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:26.782388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:26.782388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:05:26.782388 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:26.783407 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:26.783578 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:31.784294 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:36.786507 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:41.788873 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:46.790851 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:51.798168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:51.798168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:05:51.798168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:05:51.798168 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:51.798999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:05:51.798999 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:05:56.799493 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:06:01.800904 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:06:04.343982 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:04.344551 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:06.343983 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:06.802825 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:06:06.848697 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:06:06.848888 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:06:06.849010 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:06:06.849161 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Auditing locally available compute resources for np0000003683 (node: np0000003683) {{(pid=98991) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 26 03:06:06.862766 np0000003683 nova-compute[98991]: WARNING nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 26 03:06:06.863655 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 26 03:06:06.913509 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.processutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 26 03:06:06.913907 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Hypervisor/Node resource view: name=np0000003683 free_ram=52092MB free_disk=71.60064315795898GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98991) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 26 03:06:06.914082 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 26 03:06:06.914315 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 26 03:06:07.752556 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:07.967815 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 26 03:06:07.968009 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Final resource view: name=np0000003683 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:06:06 up 52 min,  2 users,  load average: 0.61, 2.27, 3.59\n'} {{(pid=98991) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 26 03:06:08.014278 np0000003683 nova-compute[98991]: DEBUG nova.virt.libvirt.driver [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98991) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}}
Jun 26 03:06:08.014506 np0000003683 nova-compute[98991]: DEBUG nova.compute.provider_tree [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed in ProviderTree for provider: af1bc8b6-4321-4361-b703-e0f6b10a10af {{(pid=98991) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 26 03:06:08.517012 np0000003683 nova-compute[98991]: DEBUG nova.scheduler.client.report [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Inventory has not changed for provider af1bc8b6-4321-4361-b703-e0f6b10a10af based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98991) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 26 03:06:09.023562 np0000003683 nova-compute[98991]: DEBUG nova.compute.resource_tracker [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Compute_service record updated for np0000003683:np0000003683 {{(pid=98991) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 26 03:06:09.024001 np0000003683 nova-compute[98991]: DEBUG oslo_concurrency.lockutils [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.109s {{(pid=98991) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 26 03:06:09.024001 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:10.023978 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:10.024511 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:10.024511 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:10.024603 np0000003683 nova-compute[98991]: DEBUG nova.compute.manager [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98991) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 26 03:06:10.024849 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.32 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:11.804566 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:06:13.340760 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:13.341642 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:13.343804 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:13.344284 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:14.343994 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:14.344749 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:16.810276 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:06:16.810751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:06:16.810751 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:06:16.810812 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:06:16.818794 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:06:16.819103 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:06:19.340427 np0000003683 nova-compute[98991]: DEBUG oslo_service.periodic_task [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98991) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 26 03:06:19.340914 np0000003683 nova-compute[98991]: DEBUG oslo.service.backend._threading.loopingcall [None req-258cc02c-07bd-4eb8-9d86-25d459193e57 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98991) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 26 03:06:21.824329 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:06:21.824791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 26 03:06:21.824791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98991) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 26 03:06:21.824791 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 26 03:06:21.825713 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98991) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 26 03:06:21.825943 np0000003683 nova-compute[98991]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98991) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}